-- Logs begin at Sun 2022-10-23 00:10:29 UTC, end at Sun 2022-10-23 01:10:15 UTC. -- Oct 23 00:41:39.407691 dv-osbrick-master-4-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Oct 23 00:41:39.416286 dv-osbrick-master-4-iscsi devstack@keystone.service[81344]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 23 00:41:39.418184 dv-osbrick-master-4-iscsi devstack@keystone.service[81344]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Oct 23 00:41:39 2022] *** Oct 23 00:41:39.418184 dv-osbrick-master-4-iscsi devstack@keystone.service[81344]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 23 00:41:39.418184 dv-osbrick-master-4-iscsi devstack@keystone.service[81344]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 23 00:41:39.418184 dv-osbrick-master-4-iscsi devstack@keystone.service[81344]: nodename: dv-osbrick-master-4-iscsi Oct 23 00:41:39.418184 dv-osbrick-master-4-iscsi devstack@keystone.service[81344]: machine: x86_64 Oct 23 00:41:39.418184 dv-osbrick-master-4-iscsi devstack@keystone.service[81344]: clock source: unix Oct 23 00:41:39.418184 dv-osbrick-master-4-iscsi devstack@keystone.service[81344]: pcre jit disabled Oct 23 00:41:39.418184 dv-osbrick-master-4-iscsi devstack@keystone.service[81344]: detected number of CPU cores: 4 Oct 23 00:41:39.418184 dv-osbrick-master-4-iscsi devstack@keystone.service[81344]: current working directory: / Oct 23 00:41:39.418184 dv-osbrick-master-4-iscsi devstack@keystone.service[81344]: detected binary path: /usr/bin/uwsgi-core Oct 23 00:41:39.418184 dv-osbrick-master-4-iscsi devstack@keystone.service[81344]: your processes number limit is 47680 Oct 23 00:41:39.418184 dv-osbrick-master-4-iscsi devstack@keystone.service[81344]: your memory page size is 4096 bytes Oct 23 00:41:39.418824 dv-osbrick-master-4-iscsi devstack@keystone.service[81344]: detected max file descriptor number: 2048 Oct 23 00:41:39.418824 dv-osbrick-master-4-iscsi devstack@keystone.service[81344]: lock engine: pthread robust mutexes Oct 23 00:41:39.418824 dv-osbrick-master-4-iscsi devstack@keystone.service[81344]: thunder lock: enabled Oct 23 00:41:39.418824 dv-osbrick-master-4-iscsi devstack@keystone.service[81344]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 23 00:41:39.418824 dv-osbrick-master-4-iscsi devstack@keystone.service[81344]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 23 00:41:39.457598 dv-osbrick-master-4-iscsi devstack@keystone.service[81344]: Python main interpreter initialized at 0x55bfcbf799c0 Oct 23 00:41:39.457598 dv-osbrick-master-4-iscsi devstack@keystone.service[81344]: python threads support enabled Oct 23 00:41:39.457598 dv-osbrick-master-4-iscsi devstack@keystone.service[81344]: your server socket listen backlog is limited to 100 connections Oct 23 00:41:39.457598 dv-osbrick-master-4-iscsi devstack@keystone.service[81344]: your mercy for graceful operations on workers is 90 seconds Oct 23 00:41:39.457966 dv-osbrick-master-4-iscsi devstack@keystone.service[81344]: mapped 403077 bytes (393 KB) for 2 cores Oct 23 00:41:39.458048 dv-osbrick-master-4-iscsi devstack@keystone.service[81344]: *** Operational MODE: preforking *** Oct 23 00:41:39.458304 dv-osbrick-master-4-iscsi devstack@keystone.service[81344]: *** uWSGI is running in multiple interpreter mode *** Oct 23 00:41:39.458304 dv-osbrick-master-4-iscsi devstack@keystone.service[81344]: spawned uWSGI master process (pid: 81344) Oct 23 00:41:39.458500 dv-osbrick-master-4-iscsi systemd[1]: Started Devstack devstack@keystone.service. Oct 23 00:41:39.462106 dv-osbrick-master-4-iscsi devstack@keystone.service[81344]: spawned uWSGI worker 1 (pid: 81358, cores: 1) Oct 23 00:41:39.462106 dv-osbrick-master-4-iscsi devstack@keystone.service[81344]: spawned uWSGI worker 2 (pid: 81359, cores: 1) Oct 23 00:41:39.462106 dv-osbrick-master-4-iscsi devstack@keystone.service[81344]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 23 00:41:43.738602 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 23 00:41:43.738602 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: from cryptography.utils import int_from_bytes Oct 23 00:41:43.739393 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 23 00:41:43.739393 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: from cryptography.utils import int_from_bytes Oct 23 00:41:43.739808 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 23 00:41:43.739808 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: from cryptography.utils import int_from_bytes Oct 23 00:41:43.739915 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 23 00:41:43.739915 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: from cryptography.utils import int_from_bytes Oct 23 00:41:43.789113 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 23 00:41:43.789255 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 23 00:41:43.789343 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 23 00:41:43.789415 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 23 00:41:43.789474 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] command line args: [] {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 23 00:41:43.789606 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] command line args: [] {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 23 00:41:43.789743 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 23 00:41:43.789828 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 23 00:41:43.789926 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ================================================================================ {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 23 00:41:43.790010 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ================================================================================ {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 23 00:41:43.790207 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] admin_token = **** {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.790296 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] admin_token = **** {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.790457 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] config_dir = [] {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.790543 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] config_dir = [] {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.790652 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.790736 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.790942 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] config_source = [] {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.791029 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] config_source = [] {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.791029 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] debug = True {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.791169 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] debug = True {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.791243 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.791452 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.791544 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.791603 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.791739 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.791846 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.791974 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.792077 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.792223 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.792336 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.792454 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] list_limit = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.792555 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] list_limit = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.792648 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] log_config_append = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.792745 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] log_config_append = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.792854 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.792949 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.793041 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] log_dir = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.793140 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] log_dir = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.793245 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] log_file = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.793345 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] log_file = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.793446 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.793541 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.793645 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.793739 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.793831 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.793929 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.794060 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.794204 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.794313 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.794413 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.794557 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.794671 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.794768 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.794909 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.795011 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.795106 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.795211 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.795323 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.795435 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.795530 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.795629 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.795734 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.795829 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.795929 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.796030 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.796140 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.796234 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.796332 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.797120 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.797264 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.797264 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.797470 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.797579 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] publish_errors = False {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.797680 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] publish_errors = False {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.797776 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.797854 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.797930 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.798007 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.798110 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.798194 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.798265 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.798350 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.798433 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.798509 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.798579 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] standard_threads = False {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.798653 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] standard_threads = False {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.798723 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.798798 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.798958 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.799036 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.799135 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.799210 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.799312 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] use_journal = False {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.799452 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] use_journal = False {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.799527 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] use_json = False {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.799601 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] use_json = False {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.799676 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] use_stderr = False {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.799751 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] use_stderr = False {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.799825 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] use_syslog = False {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.799903 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] use_syslog = False {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.800037 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.800121 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 23 00:41:43.800292 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.800373 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.800531 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.800614 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.800794 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.800870 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.801036 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.801116 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.801286 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.801370 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.801526 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.801606 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.801774 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.801855 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.802012 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.802122 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.802292 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.802367 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.802543 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.802617 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.802794 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.802876 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.803032 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.803102 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.803278 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.803354 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.803516 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.803602 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.803762 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.803844 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.804011 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.804086 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.804248 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.804330 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.804505 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.804581 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.804759 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.804833 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.805006 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.805156 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.805229 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.805297 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.805485 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.805572 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.805746 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.805828 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.806000 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.806102 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.806280 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.806356 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.806515 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.806591 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.806745 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.806819 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.806978 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.807053 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.807213 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.807289 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.807463 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.807543 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.807711 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.807786 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.807943 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.808018 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.808175 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.808248 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.808424 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.808505 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.808671 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.808752 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.808908 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.808982 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.809156 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.809236 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.809388 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.809463 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.809624 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.809704 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.809861 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.809935 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.810132 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.810222 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.810350 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.810424 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.810586 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.810660 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.810804 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.810876 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.811045 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.811121 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.811293 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.811369 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.811526 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.811602 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.811761 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.811841 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.811991 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.812066 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.812226 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.812302 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.812607 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.812730 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.812730 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.812915 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.813017 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.813111 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.813203 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.813296 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.813388 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.813488 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.813611 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.813723 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.813835 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.813982 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.814135 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.814771 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.814890 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.814993 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.815110 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.815222 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.815324 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.815446 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.815560 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.815673 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.815785 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.815908 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.816031 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.816153 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.816267 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.816381 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.816494 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.816606 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.816708 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.816819 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.816931 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.817051 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.817165 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.817277 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.817390 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.817502 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.817613 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.817734 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.817854 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.817974 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.818126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.818255 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.818371 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.818481 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.818595 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.818703 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.818823 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.818936 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.819049 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.819169 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.819283 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.819400 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.819513 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.819625 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.819738 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.819859 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.819974 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.820086 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.820199 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.820312 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.820425 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.820549 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.820664 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.820777 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.820891 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.821004 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.821116 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.821235 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.821350 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.821462 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.821575 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.821686 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.821798 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.821920 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.822034 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.822169 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.822284 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.822396 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.822509 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.822698 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.822814 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.822933 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.823048 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.823160 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.823282 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.823404 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.823527 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.823641 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.823754 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.823865 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.823978 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.824097 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.824219 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.824333 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.824445 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.824557 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.824676 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.824789 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.824910 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.825024 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.825138 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.825250 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.825362 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.825481 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.825603 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.825717 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.825830 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.825942 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.826063 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.826255 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.826380 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] auth.external = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.826495 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] auth.external = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.826617 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.826732 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.826846 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.826960 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.827075 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.827196 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.827319 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] auth.password = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.827439 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] auth.password = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.827554 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] auth.token = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.827667 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] auth.token = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.827786 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.827906 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.828029 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.828144 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.828258 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.828371 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.828484 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.828597 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.828718 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.828833 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.828947 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.829060 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.829180 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.829295 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.829421 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] credential.caching = True {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.829535 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] credential.caching = True {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.829649 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.829762 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.829875 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.830542 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.830675 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.830791 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.830905 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.831019 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.831132 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.831245 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.831368 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.831483 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.831597 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.831710 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.831823 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.831936 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.832060 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.832176 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.832290 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.832405 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.832518 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.832631 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.832753 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.832867 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.832980 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.833093 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.833207 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.833319 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.833446 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.833561 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.833675 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] federation.caching = True {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.833788 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] federation.caching = True {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.833901 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.834014 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.834163 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.834287 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.834403 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.834518 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.834631 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.834744 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.834866 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.834981 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.835096 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.835209 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.835322 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.835443 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.835561 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.835675 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.835794 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.835908 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.836023 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.836144 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.836268 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.836366 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.836479 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] identity.caching = True {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.836599 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] identity.caching = True {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.836714 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.836899 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.837017 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.837131 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.837246 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.837359 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.837473 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.837707 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.837830 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.837944 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.838059 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.838194 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.838309 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.838425 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.838539 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.838654 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.838769 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.838882 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.838996 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.839116 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.839231 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.839349 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.839464 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.839567 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.839679 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.839807 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.839923 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.840037 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.840151 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.840264 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.840383 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.840510 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.840626 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.840746 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.840862 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.840982 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.841102 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.841224 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.841346 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.841465 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.841579 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.841692 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.841805 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.841927 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.842042 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.842200 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.842313 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.842424 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.842536 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.842660 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.842775 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.842895 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.843008 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.843120 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.843231 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.843351 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.843465 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.843577 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.843689 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.843801 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.843914 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.844034 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.844148 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.844260 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.844372 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.844483 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.844603 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.844722 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.844835 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.844947 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.845060 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.845172 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.845291 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.845405 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.845539 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.845656 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.845770 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.845883 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.846005 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.846165 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.846293 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.846409 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.846523 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.846636 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.846758 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.846873 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.846987 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.847101 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.847213 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.847327 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.847448 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.847562 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.847676 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.847789 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.847903 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.848016 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.848138 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.848253 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.848378 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.848493 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.848607 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.user = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.848720 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.user = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.848841 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.848956 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.849070 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.849184 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.849298 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.849415 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.849536 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.849651 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.849764 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.849877 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.849990 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.850153 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.850533 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.850652 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.850766 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.850879 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.850993 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.851106 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.851228 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.851344 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.851457 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.851570 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.851683 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.851802 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.851925 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.852039 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.852153 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.852266 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.852380 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.852493 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.852613 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.852728 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.852842 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.852955 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.853068 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.853181 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.853302 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.853418 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.853532 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.853645 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.853758 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.853872 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.853993 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.854121 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.854237 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.854350 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.854464 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.854577 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.854701 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.854816 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.854930 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.855043 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.855162 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.855276 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.855397 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.855513 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.855626 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.855739 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.855852 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.855964 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.856085 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.856200 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.856313 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.856426 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.856541 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.856655 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.856776 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.856891 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.857004 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.857117 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.857230 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.857343 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.857464 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] resource.caching = True {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.857580 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] resource.caching = True {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.857693 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.857807 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.857920 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.858033 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.858191 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.858307 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.858421 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.858534 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.858649 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.858762 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.858883 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.858997 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.859111 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.859225 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.859342 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.859529 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.859647 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.859647 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] role.caching = True {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.859860 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.859860 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] role.caching = True {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.860072 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] role.driver = sql {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.860072 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.860294 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] role.driver = sql {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.860294 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.860506 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.860619 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.860733 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.860854 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.860970 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.861084 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.861728 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.861843 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.861956 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.862096 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.862207 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.862321 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.862434 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.862547 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.862660 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.862660 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.862886 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.862886 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.863097 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.863097 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.863310 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.863431 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.863546 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.863660 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.863774 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.863774 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.863987 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.863987 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.864210 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.864324 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.864444 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.864559 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.864673 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.864795 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.864910 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.865023 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.865137 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.865250 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.865371 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.865486 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.865599 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.865712 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.865825 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.865938 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.866063 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.866226 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.866340 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.866453 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.866565 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.866677 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.866802 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.866918 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.867033 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.867147 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.867259 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.867372 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.867492 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.867608 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.867720 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.867834 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.867947 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.868061 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.868181 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.868295 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] token.caching = True {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.868408 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.868567 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.868681 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] token.caching = True {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.868794 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.868914 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.869029 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.869142 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.869255 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.869370 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.869484 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.869605 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.869720 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.869833 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.869946 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.870059 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.870193 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.870318 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.870434 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.870547 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.870659 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.870772 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.870884 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.871004 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.871118 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.871232 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.871344 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.871457 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.871457 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.871675 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.871675 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.871896 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.872018 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.872133 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.872256 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.872379 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.872527 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] database.connection = **** {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.872644 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.872766 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.872881 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] database.connection = **** {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.872994 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.873106 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.873219 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.873333 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.873453 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.873568 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.873681 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.873793 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.873907 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.874019 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.874199 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.874315 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.874430 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.874573 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.874688 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.874802 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.874923 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.875039 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.875152 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.875265 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.875379 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.875492 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.875603 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.875717 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.875831 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.875943 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.876056 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.876169 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.876290 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.876404 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.876519 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.876632 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.876799 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.876922 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.877536 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81359) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 23 00:41:43.877654 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 23 00:41:43.877654 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 23 00:41:43.906650 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:43.906858 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:43.906959 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:43.907091 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:43.907173 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:43.907319 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:43.915586 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:43.915822 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:43.945999 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:43.946257 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:43.947304 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:43.947541 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:43.998375 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:43.998661 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:44.046695 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:44.046806 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:44.046933 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:44.047012 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:44.202927 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:44.203101 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:44.203236 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:44.203315 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:44.203388 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:44.203481 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:44.203588 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:44.203706 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:44.203813 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:44.203928 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:44.204019 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:44.204148 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:44.227318 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:44.227501 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:44.227585 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:44.227737 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:44.227819 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:44.227966 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:44.228048 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:44.228192 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:44.228282 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:44.228411 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:44.228491 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:44.228629 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:44.228706 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:44.228847 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:44.240492 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:44.240662 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:44.253999 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:44.254146 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:44.254230 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:44.254383 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:44.254467 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:44.254598 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:44.254681 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:44.254824 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:44.254917 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:44.255044 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:44.255121 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:44.255250 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:44.255332 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:44.255466 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81359) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 23 00:41:44.271929 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.272143 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 23 00:41:44.272379 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.272490 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.272594 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 23 00:41:44.272690 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 23 00:41:44.272939 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.273023 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.273141 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 23 00:41:44.273222 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.273416 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.273680 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.273757 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.273963 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.274302 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.274570 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.283872 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.284154 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.284371 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.284453 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.284655 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.284749 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.284930 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.285211 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.291648 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:41:44.292133 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:41:44.294552 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:41:44.294842 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.295036 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:41:44.295117 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.295322 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.295409 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.295606 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.295688 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.295891 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.295972 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.296176 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.296265 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.296445 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.296524 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.296720 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.296838 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.296996 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.297121 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.297384 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.297463 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.297662 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.297935 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.320290 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.320826 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.321748 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:41:44.322039 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.322304 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:41:44.322589 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.328410 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:41:44.328702 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.328906 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:41:44.328985 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.329192 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.329476 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.335349 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:41:44.335647 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.335824 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:41:44.336115 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.339735 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:41:44.340033 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.340195 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:41:44.340324 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.340489 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.340656 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.340776 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.340881 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.341064 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.341164 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.341345 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.341426 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.341622 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.341701 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.341894 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.342196 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.357897 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.358209 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.358376 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.358657 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.362640 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:41:44.363065 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:41:44.365837 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.366167 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.366287 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.366586 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.370375 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:41:44.370784 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:41:44.373502 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:41:44.373932 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:41:44.376728 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.377057 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.377168 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.377363 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.377469 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.377664 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.377752 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.377958 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.378038 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.378267 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.378347 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.378609 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.393915 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:41:44.394232 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.394313 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:41:44.394509 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.394589 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.394780 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.394864 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.395060 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.401607 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.401851 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.403173 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.403409 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.404710 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.404928 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.405009 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.405217 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.407678 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:41:44.407885 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:41:44.407967 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.408689 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.408859 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.409086 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.409172 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.409374 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.409463 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.409655 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.420508 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:41:44.420687 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:41:44.420802 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.420976 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.421192 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.421361 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.421483 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.421647 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.421785 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.421942 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.422099 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.422254 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.422383 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.422535 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.438296 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:41:44.438404 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:41:44.441222 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:41:44.441316 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:41:44.444103 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.444186 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.445638 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.445720 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.447303 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:41:44.447424 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:41:44.447605 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.447721 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.447895 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.448018 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.454214 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.454332 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.455721 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:41:44.455813 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:41:44.458751 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.458832 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.459047 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.459128 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.459335 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.459427 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.459615 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.459700 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.467376 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:41:44.467465 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:41:44.467670 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.467752 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.467955 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.468037 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.476455 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:41:44.476568 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81359) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 23 00:41:44.476743 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.476824 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.477024 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.477104 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.477306 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.477397 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.477582 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.477661 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.477858 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.477937 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.478159 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.478253 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.478453 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.478535 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.478728 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.478809 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.478996 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.479075 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.479269 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.479359 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.479552 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.479632 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.479823 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.479902 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.480093 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.480184 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81359) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 23 00:41:44.513395 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bfcbf799c0 pid: 81359 (default app) Oct 23 00:41:44.513493 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bfcbf799c0 pid: 81358 (default app) Oct 23 00:41:44.516624 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822cc2e-a3de-4884-8f4f-389213830254 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:41:44.516911 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822cc2e-a3de-4884-8f4f-389213830254 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:41:44.517186 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822cc2e-a3de-4884-8f4f-389213830254 None None] PATH_INFO: `/v3` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:41:44.521368 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 791 bytes} [Sun Oct 23 00:41:44 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:41:51.238241 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7766d-cbcb-4631-a4d3-7850c3fdefec None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:41:51.238670 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7766d-cbcb-4631-a4d3-7850c3fdefec None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:41:51.238803 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7766d-cbcb-4631-a4d3-7850c3fdefec None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:41:51.243074 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 1/2] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:41:51 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:41:51.248321 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f1e53-8082-4908-964a-be977ffb04fa None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:41:51.248758 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f1e53-8082-4908-964a-be977ffb04fa None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:41:51.248896 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f1e53-8082-4908-964a-be977ffb04fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:41:51.318309 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: INFO dbcounter [None req-d04f1e53-8082-4908-964a-be977ffb04fa None None] Registered counter for database keystone Oct 23 00:41:51.337104 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG oslo_db.sqlalchemy.engines [None req-d04f1e53-8082-4908-964a-be977ffb04fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81359) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 00:41:51.343317 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writer thread running {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 00:41:51.521216 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG passlib.handlers.bcrypt [None req-d04f1e53-8082-4908-964a-be977ffb04fa None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81359) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 23 00:41:51.521522 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG passlib.handlers.bcrypt [None req-d04f1e53-8082-4908-964a-be977ffb04fa None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81359) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 23 00:41:51.578515 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-d04f1e53-8082-4908-964a-be977ffb04fa None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:41:51.580115 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-d04f1e53-8082-4908-964a-be977ffb04fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:41:51.707212 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 2/3] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:41:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 23 00:41:52.137572 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7766d-cbcb-4631-a4d3-7850c3fdefec None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:41:52.207082 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: INFO dbcounter [None req-5ee7766d-cbcb-4631-a4d3-7850c3fdefec None None] Registered counter for database keystone Oct 23 00:41:52.229026 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG oslo_db.sqlalchemy.engines [None req-5ee7766d-cbcb-4631-a4d3-7850c3fdefec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81358) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 23 00:41:52.235206 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writer thread running {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 23 00:41:52.353022 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7766d-cbcb-4631-a4d3-7850c3fdefec None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:41:52.357466 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda4eb59-ece5-4892-a44a-ca8768bf58f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:41:52.358124 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4eb59-ece5-4892-a44a-ca8768bf58f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:41:52.358415 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4eb59-ece5-4892-a44a-ca8768bf58f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:41:52.358689 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4eb59-ece5-4892-a44a-ca8768bf58f5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:41:52.367524 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda4eb59-ece5-4892-a44a-ca8768bf58f5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:41:52.419524 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: WARNING keystone.common.rbac_enforcer.enforcer [None req-cda4eb59-ece5-4892-a44a-ca8768bf58f5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 23 00:41:52.419821 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda4eb59-ece5-4892-a44a-ca8768bf58f5 admin admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:41:52.429661 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1324 bytes} [Sun Oct 23 00:41:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 23 00:41:52.435555 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f1e53-8082-4908-964a-be977ffb04fa None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:41:52.453146 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f1e53-8082-4908-964a-be977ffb04fa None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:41:52.457587 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05f1a9-3118-465c-a79f-3b5e54c60120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:41:52.458728 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05f1a9-3118-465c-a79f-3b5e54c60120 admin admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:41:52.459022 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05f1a9-3118-465c-a79f-3b5e54c60120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:41:52.459296 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05f1a9-3118-465c-a79f-3b5e54c60120 admin admin] PATH_INFO: `/v3/projects/1e595cb6a4664ac2825c0ea6a16cb095` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:41:52.463099 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e05f1a9-3118-465c-a79f-3b5e54c60120 admin admin] RBAC: Authorizing `identity:get_project(project_id=1e595cb6a4664ac2825c0ea6a16cb095)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:41:52.515002 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7e05f1a9-3118-465c-a79f-3b5e54c60120 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 23 00:41:52.515353 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e05f1a9-3118-465c-a79f-3b5e54c60120 admin admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:41:52.519894 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 3/5] 10.222.0.23 () {56 vars in 1207 bytes} [Sun Oct 23 00:41:52 2022] GET /identity/v3/projects/1e595cb6a4664ac2825c0ea6a16cb095 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:41:54.627414 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25027f9e-8d6c-46a8-8084-4f308ea85459 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:41:54.627939 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25027f9e-8d6c-46a8-8084-4f308ea85459 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:41:54.628025 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25027f9e-8d6c-46a8-8084-4f308ea85459 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:41:54.632720 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 3/6] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:41:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:41:54.638310 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4143c18-3af3-4255-8a12-3e933f893e3f None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:41:54.638731 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4143c18-3af3-4255-8a12-3e933f893e3f None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:41:54.638852 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4143c18-3af3-4255-8a12-3e933f893e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:41:54.658507 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-e4143c18-3af3-4255-8a12-3e933f893e3f None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:41:54.660004 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-e4143c18-3af3-4255-8a12-3e933f893e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:41:54.667681 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 4/7] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:41:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 23 00:41:54.935272 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25027f9e-8d6c-46a8-8084-4f308ea85459 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:41:54.947252 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25027f9e-8d6c-46a8-8084-4f308ea85459 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:41:54.951425 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba752c48-28cc-4419-b050-3a25016d440a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:41:54.952020 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba752c48-28cc-4419-b050-3a25016d440a admin admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:41:54.952323 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba752c48-28cc-4419-b050-3a25016d440a admin admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:41:54.952597 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba752c48-28cc-4419-b050-3a25016d440a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:41:54.960112 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba752c48-28cc-4419-b050-3a25016d440a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:41:54.961884 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba752c48-28cc-4419-b050-3a25016d440a admin admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:41:54.970514 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 4/8] 10.222.0.23 () {58 vars in 1324 bytes} [Sun Oct 23 00:41:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 00:41:54.976139 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4143c18-3af3-4255-8a12-3e933f893e3f None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:41:54.985343 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4143c18-3af3-4255-8a12-3e933f893e3f None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:41:54.990288 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ba7ac-1e26-4703-b47a-6e3bf9dfca0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:41:54.990906 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ba7ac-1e26-4703-b47a-6e3bf9dfca0c admin admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:41:54.991185 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ba7ac-1e26-4703-b47a-6e3bf9dfca0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:41:54.991457 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ba7ac-1e26-4703-b47a-6e3bf9dfca0c admin admin] PATH_INFO: `/v3/users/39aa566fa6c64c41804fb6eefcbf0c20` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:41:54.992755 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ba7ac-1e26-4703-b47a-6e3bf9dfca0c admin admin] RBAC: Authorizing `identity:get_user(user_id=39aa566fa6c64c41804fb6eefcbf0c20)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:41:54.994621 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ba7ac-1e26-4703-b47a-6e3bf9dfca0c admin admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:41:54.996121 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 5/9] 10.222.0.23 () {56 vars in 1198 bytes} [Sun Oct 23 00:41:54 2022] GET /identity/v3/users/39aa566fa6c64c41804fb6eefcbf0c20 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:41:57.180001 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1101d-5c09-4c51-a75b-cf4dd6847ce1 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:41:57.180576 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1101d-5c09-4c51-a75b-cf4dd6847ce1 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:41:57.180576 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1101d-5c09-4c51-a75b-cf4dd6847ce1 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:41:57.181887 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 5/10] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:41:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:41:57.187047 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0f95b-4c1b-4724-816f-8e7389eaa36f None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:41:57.187472 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0f95b-4c1b-4724-816f-8e7389eaa36f None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:41:57.187595 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0f95b-4c1b-4724-816f-8e7389eaa36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:41:57.205674 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-76f0f95b-4c1b-4724-816f-8e7389eaa36f None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:41:57.207426 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-76f0f95b-4c1b-4724-816f-8e7389eaa36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:41:57.238480 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fca4a5-de0c-407a-8f65-546f6ef171c9 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:41:57.238770 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fca4a5-de0c-407a-8f65-546f6ef171c9 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:41:57.239048 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fca4a5-de0c-407a-8f65-546f6ef171c9 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:41:57.240374 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 6/11] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:41:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:41:57.246433 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53327f7-c855-46e8-a83c-b6ef8f18c6cc None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:41:57.246894 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53327f7-c855-46e8-a83c-b6ef8f18c6cc None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:41:57.247331 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53327f7-c855-46e8-a83c-b6ef8f18c6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:41:57.289078 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG passlib.handlers.bcrypt [None req-c53327f7-c855-46e8-a83c-b6ef8f18c6cc None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81358) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 23 00:41:57.289458 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG passlib.handlers.bcrypt [None req-c53327f7-c855-46e8-a83c-b6ef8f18c6cc None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81358) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 23 00:41:57.290774 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 6/12] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:41:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:41:57.338632 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-c53327f7-c855-46e8-a83c-b6ef8f18c6cc None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:41:57.340187 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-c53327f7-c855-46e8-a83c-b6ef8f18c6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:41:57.436143 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 7/13] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:41:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 00:41:57.562778 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f0f95b-4c1b-4724-816f-8e7389eaa36f None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:41:57.586765 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:41:57.666179 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f0f95b-4c1b-4724-816f-8e7389eaa36f None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:41:57.699365 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53327f7-c855-46e8-a83c-b6ef8f18c6cc None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:41:57.699691 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea7d1a-2971-4bd5-95b0-3ad184cbfe99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:41:57.700338 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea7d1a-2971-4bd5-95b0-3ad184cbfe99 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:41:57.700624 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea7d1a-2971-4bd5-95b0-3ad184cbfe99 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:41:57.700903 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea7d1a-2971-4bd5-95b0-3ad184cbfe99 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:41:57.712182 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea7d1a-2971-4bd5-95b0-3ad184cbfe99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:41:57.721118 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-02ea7d1a-2971-4bd5-95b0-3ad184cbfe99 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:41:57.721118 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:41:57.721118 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:41:57.721118 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:41:57.721118 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:41:57.721118 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:41:57.721118 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:41:57.721118 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:41:57.721118 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:41:57.721118 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:41:57.721118 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:41:57.721118 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:41:57.721118 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:41:57.721118 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:41:57.721118 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:41:57.721118 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:41:57.722066 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:41:57.722066 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:41:57.722066 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:41:57.722066 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:41:57.722066 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:41:57.722066 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:41:57.722066 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:41:57.722066 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:41:57.722066 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:41:57.722066 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:41:57.722066 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:41:57.722066 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:41:57.722066 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:41:57.722066 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:41:57.722066 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:41:57.722066 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:41:57.722936 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:41:57.722936 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:41:57.722936 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:41:57.722936 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:41:57.722936 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:41:57.722936 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:41:57.722936 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:41:57.722936 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:41:57.722936 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:41:57.722936 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:41:57.722936 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:41:57.722936 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:41:57.722936 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 7/14] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 23 00:41:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:41:57.728340 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea7d1a-2971-4bd5-95b0-3ad184cbfe99 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:41:57.801518 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53327f7-c855-46e8-a83c-b6ef8f18c6cc None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:41:57.803794 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:41:57.809203 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:41:57.827779 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea7d1a-2971-4bd5-95b0-3ad184cbfe99 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:41:57.838201 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff685722-df65-4fcf-b393-1c7c52474df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:41:57.839062 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff685722-df65-4fcf-b393-1c7c52474df6 None admin] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:41:57.839348 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff685722-df65-4fcf-b393-1c7c52474df6 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:41:57.839623 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff685722-df65-4fcf-b393-1c7c52474df6 None admin] PATH_INFO: `/v3/domains` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:41:57.840606 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff685722-df65-4fcf-b393-1c7c52474df6 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:41:57.842057 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff685722-df65-4fcf-b393-1c7c52474df6 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:41:57.853717 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.sql.core [None req-ff685722-df65-4fcf-b393-1c7c52474df6 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 23 00:41:57.853717 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 23 00:41:57.853717 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [parameters: {'id': '36e60000de194ce78585519507e084d4', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 23 00:41:57.853717 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81358) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 23 00:41:57.861343 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116cef14-0b41-4ade-938d-3c278946b3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:41:57.861941 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116cef14-0b41-4ade-938d-3c278946b3ad None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:41:57.862797 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116cef14-0b41-4ade-938d-3c278946b3ad None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:41:57.863075 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116cef14-0b41-4ade-938d-3c278946b3ad None admin] PATH_INFO: `/v3/roles` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:41:57.863735 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116cef14-0b41-4ade-938d-3c278946b3ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:41:57.864034 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116cef14-0b41-4ade-938d-3c278946b3ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:41:57.865406 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116cef14-0b41-4ade-938d-3c278946b3ad None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:41:57.872553 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-ff685722-df65-4fcf-b393-1c7c52474df6 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 23 00:41:57.872553 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:41:57.872553 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 23 00:41:57.872553 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 23 00:41:57.872553 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 23 00:41:57.872553 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 23 00:41:57.872553 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 23 00:41:57.872553 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application result = self._query(query) Oct 23 00:41:57.872553 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 23 00:41:57.872553 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application conn.query(q) Oct 23 00:41:57.872553 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 23 00:41:57.872553 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 23 00:41:57.872553 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 23 00:41:57.872553 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application result.read() Oct 23 00:41:57.873409 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 23 00:41:57.873409 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 23 00:41:57.873409 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 23 00:41:57.873409 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 23 00:41:57.873409 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 23 00:41:57.873409 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 23 00:41:57.873409 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 23 00:41:57.873409 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 23 00:41:57.873409 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 23 00:41:57.873409 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:41:57.873409 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 23 00:41:57.873409 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:41:57.873409 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:41:57.873409 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 23 00:41:57.873409 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 23 00:41:57.873409 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 23 00:41:57.873409 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 23 00:41:57.873409 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 23 00:41:57.874352 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application next(self.gen) Oct 23 00:41:57.874352 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 23 00:41:57.874352 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application yield resource Oct 23 00:41:57.874352 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 23 00:41:57.874352 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application next(self.gen) Oct 23 00:41:57.874352 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 23 00:41:57.874352 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application self.session.rollback() Oct 23 00:41:57.874352 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 00:41:57.874352 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application self.force_reraise() Oct 23 00:41:57.874352 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 00:41:57.874352 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise self.value Oct 23 00:41:57.874352 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 23 00:41:57.874352 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 23 00:41:57.874352 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 23 00:41:57.874352 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application session.commit() Oct 23 00:41:57.874352 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 23 00:41:57.874352 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 23 00:41:57.875187 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 23 00:41:57.875187 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application self._prepare_impl() Oct 23 00:41:57.875187 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 23 00:41:57.875187 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application self.session.flush() Oct 23 00:41:57.875187 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 23 00:41:57.875187 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application self._flush(objects) Oct 23 00:41:57.875187 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 23 00:41:57.875187 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 23 00:41:57.875187 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 23 00:41:57.875187 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application compat.raise_( Oct 23 00:41:57.875187 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 00:41:57.875187 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception Oct 23 00:41:57.875187 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 23 00:41:57.875187 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application flush_context.execute() Oct 23 00:41:57.875187 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 23 00:41:57.875187 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rec.execute(self) Oct 23 00:41:57.875187 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 23 00:41:57.876039 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 23 00:41:57.876039 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 23 00:41:57.876039 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 23 00:41:57.876039 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 23 00:41:57.876039 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 23 00:41:57.876039 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 23 00:41:57.876039 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 23 00:41:57.876039 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 23 00:41:57.876039 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 23 00:41:57.876039 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 23 00:41:57.876039 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 23 00:41:57.876039 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 23 00:41:57.876039 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 23 00:41:57.876039 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 23 00:41:57.876039 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 23 00:41:57.876790 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 00:41:57.876790 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception Oct 23 00:41:57.876790 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 23 00:41:57.876790 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 23 00:41:57.876790 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 23 00:41:57.876790 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 23 00:41:57.876790 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 23 00:41:57.876790 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application result = self._query(query) Oct 23 00:41:57.876790 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 23 00:41:57.876790 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application conn.query(q) Oct 23 00:41:57.876790 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 23 00:41:57.876790 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 23 00:41:57.876790 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 23 00:41:57.876790 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application result.read() Oct 23 00:41:57.876790 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 23 00:41:57.876790 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 23 00:41:57.876790 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 23 00:41:57.877566 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 23 00:41:57.877566 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 23 00:41:57.877566 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 23 00:41:57.877566 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 23 00:41:57.877566 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 23 00:41:57.877566 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 23 00:41:57.877566 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 23 00:41:57.877566 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [parameters: {'id': '36e60000de194ce78585519507e084d4', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 23 00:41:57.877566 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 23 00:41:57.877566 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:41:57.877566 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:41:57.877566 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:41:57.877566 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:41:57.877566 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 23 00:41:57.877566 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 23 00:41:57.878397 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 23 00:41:57.878397 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 23 00:41:57.878397 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 23 00:41:57.878397 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:41:57.878397 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:41:57.878397 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:41:57.878397 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:41:57.878397 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:41:57.878397 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:41:57.878397 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:41:57.878397 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:41:57.878397 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:41:57.878397 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:41:57.878397 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:41:57.878397 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:41:57.878397 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:41:57.878397 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:41:57.879600 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 23 00:41:57.879600 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 23 00:41:57.879600 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:41:57.879600 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:41:57.879600 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 23 00:41:57.879600 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 23 00:41:57.879600 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:41:57.879600 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:41:57.879600 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 23 00:41:57.879600 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 23 00:41:57.879600 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 23 00:41:57.879600 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:41:57.879600 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 8/15] 10.222.0.23 () {60 vars in 1137 bytes} [Sun Oct 23 00:41:57 2022] POST /identity/v3/domains => generated 190 bytes in 175 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:41:57.887026 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 8/16] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 23 00:41:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:41:57.887161 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff685722-df65-4fcf-b393-1c7c52474df6 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:41:57.888216 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116cef14-0b41-4ade-938d-3c278946b3ad None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:41:57.984895 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff685722-df65-4fcf-b393-1c7c52474df6 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:41:57.986017 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116cef14-0b41-4ade-938d-3c278946b3ad None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:41:58.017878 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a105f-b381-47cf-8cfd-9d4d92a481ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:41:58.018993 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a105f-b381-47cf-8cfd-9d4d92a481ed None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:41:58.019275 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a105f-b381-47cf-8cfd-9d4d92a481ed None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:41:58.019549 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a105f-b381-47cf-8cfd-9d4d92a481ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:41:58.019848 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e2cb9-e60c-4488-bf31-4156ae7fb08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:41:58.020485 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e2cb9-e60c-4488-bf31-4156ae7fb08c None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:41:58.020765 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e2cb9-e60c-4488-bf31-4156ae7fb08c None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:41:58.021035 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e2cb9-e60c-4488-bf31-4156ae7fb08c None admin] PATH_INFO: `/v3/users/39aa566fa6c64c41804fb6eefcbf0c20` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:41:58.022185 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e2cb9-e60c-4488-bf31-4156ae7fb08c None admin] RBAC: Authorizing `identity:get_user(user_id=39aa566fa6c64c41804fb6eefcbf0c20)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:41:58.023640 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e2cb9-e60c-4488-bf31-4156ae7fb08c None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:41:58.025230 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 9/17] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 23 00:41:57 2022] GET /identity/v3/users/39aa566fa6c64c41804fb6eefcbf0c20 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:41:58.030584 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e2cb9-e60c-4488-bf31-4156ae7fb08c None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:41:58.038263 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7a105f-b381-47cf-8cfd-9d4d92a481ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:41:58.039987 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7a105f-b381-47cf-8cfd-9d4d92a481ed None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:41:58.046042 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:41:58.057205 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-9b7a105f-b381-47cf-8cfd-9d4d92a481ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:41:58.057205 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:41:58.057205 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:41:58.057205 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:41:58.057205 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:41:58.057205 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:41:58.057205 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:41:58.057205 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:41:58.057205 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:41:58.057205 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:41:58.057205 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:41:58.057205 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:41:58.057205 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:41:58.057205 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:41:58.057205 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:41:58.057205 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:41:58.058095 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:41:58.058095 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:41:58.058095 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:41:58.058095 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:41:58.058095 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:41:58.058095 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:41:58.058095 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:41:58.058095 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:41:58.058095 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:41:58.058095 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:41:58.058095 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:41:58.058095 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:41:58.058095 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:41:58.058095 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:41:58.058095 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:41:58.058095 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:41:58.058095 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:41:58.058908 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:41:58.058908 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:41:58.058908 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:41:58.058908 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 9/18] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:41:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:41:58.064121 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a105f-b381-47cf-8cfd-9d4d92a481ed None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:41:58.089167 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:41:58.132819 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e2cb9-e60c-4488-bf31-4156ae7fb08c None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:41:58.166902 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a105f-b381-47cf-8cfd-9d4d92a481ed None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:41:58.167059 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45dccb-c373-4871-bf16-fa5cdddd7178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:41:58.167680 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45dccb-c373-4871-bf16-fa5cdddd7178 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:41:58.167960 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45dccb-c373-4871-bf16-fa5cdddd7178 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:41:58.168235 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45dccb-c373-4871-bf16-fa5cdddd7178 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:41:58.169345 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de45dccb-c373-4871-bf16-fa5cdddd7178 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:41:58.170838 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de45dccb-c373-4871-bf16-fa5cdddd7178 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:41:58.172387 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 10/19] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:41:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:41:58.178020 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45dccb-c373-4871-bf16-fa5cdddd7178 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:41:58.200331 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39370a-d754-4ed1-b81d-410de397025c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:41:58.200940 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39370a-d754-4ed1-b81d-410de397025c None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:41:58.201219 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39370a-d754-4ed1-b81d-410de397025c None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:41:58.201497 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39370a-d754-4ed1-b81d-410de397025c None admin] PATH_INFO: `/v3/domains` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:41:58.202166 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd39370a-d754-4ed1-b81d-410de397025c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:41:58.202470 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd39370a-d754-4ed1-b81d-410de397025c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:41:58.203853 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd39370a-d754-4ed1-b81d-410de397025c None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:41:58.220970 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 10/20] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:41:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:41:58.265440 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:41:58.287463 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45dccb-c373-4871-bf16-fa5cdddd7178 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:41:58.322520 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381bfa3e-9bad-49fc-b294-f3ee5f550cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:41:58.323197 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bfa3e-9bad-49fc-b294-f3ee5f550cc8 None admin] REQUEST_METHOD: `PUT` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:41:58.323475 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bfa3e-9bad-49fc-b294-f3ee5f550cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:41:58.323747 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bfa3e-9bad-49fc-b294-f3ee5f550cc8 None admin] PATH_INFO: `/v3/domains/default/users/39aa566fa6c64c41804fb6eefcbf0c20/roles/1e2073be75174689aa4fac29e674583d` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:41:58.325720 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381bfa3e-9bad-49fc-b294-f3ee5f550cc8 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=39aa566fa6c64c41804fb6eefcbf0c20, role_id=1e2073be75174689aa4fac29e674583d)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:41:58.327226 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381bfa3e-9bad-49fc-b294-f3ee5f550cc8 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:41:58.443323 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 11/21] 10.222.0.23 () {58 vars in 1361 bytes} [Sun Oct 23 00:41:58 2022] PUT /identity/v3/domains/default/users/39aa566fa6c64c41804fb6eefcbf0c20/roles/1e2073be75174689aa4fac29e674583d => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:42:00.869573 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899ad06-15cd-4998-876e-03a766205e3d None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:00.870106 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899ad06-15cd-4998-876e-03a766205e3d None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:00.870210 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899ad06-15cd-4998-876e-03a766205e3d None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:00.871621 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 11/22] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:42:00.891367 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3220df-38ad-475b-8558-39061f23b87b None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:00.891869 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3220df-38ad-475b-8558-39061f23b87b None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:00.891941 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3220df-38ad-475b-8558-39061f23b87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:00.927263 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-bd3220df-38ad-475b-8558-39061f23b87b None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:00.928812 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-bd3220df-38ad-475b-8558-39061f23b87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:01.012704 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 12/23] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 00:42:01.048980 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508f3f6-9c55-44a4-96f2-2b3f38b1a7e6 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:01.049279 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508f3f6-9c55-44a4-96f2-2b3f38b1a7e6 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:01.049530 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508f3f6-9c55-44a4-96f2-2b3f38b1a7e6 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:01.051093 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 12/24] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:42:01.056208 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873c9c6-8c08-4db9-afa3-c15ba79ae1f2 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:01.056502 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873c9c6-8c08-4db9-afa3-c15ba79ae1f2 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:01.056780 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873c9c6-8c08-4db9-afa3-c15ba79ae1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:01.076479 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-0873c9c6-8c08-4db9-afa3-c15ba79ae1f2 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:01.077668 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-0873c9c6-8c08-4db9-afa3-c15ba79ae1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:01.142581 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:01.150718 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 13/25] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:42:01.237192 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5f1d5-800d-4c7c-b538-15e78c8aa285 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:01.238016 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5f1d5-800d-4c7c-b538-15e78c8aa285 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:01.238548 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5f1d5-800d-4c7c-b538-15e78c8aa285 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:01.240139 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 13/26] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:42:01.251932 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3122a-60f8-41f8-a7b9-ccd7fef27e40 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:01.252548 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3122a-60f8-41f8-a7b9-ccd7fef27e40 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:01.253086 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3122a-60f8-41f8-a7b9-ccd7fef27e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:01.282408 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-11e3122a-60f8-41f8-a7b9-ccd7fef27e40 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:01.283978 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-11e3122a-60f8-41f8-a7b9-ccd7fef27e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:01.372403 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 14/27] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 00:42:01.405849 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd5f1d5-800d-4c7c-b538-15e78c8aa285 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:01.458310 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e9658-acbd-4d3f-91a9-74d64795575c None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:01.458918 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e9658-acbd-4d3f-91a9-74d64795575c None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:01.459426 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e9658-acbd-4d3f-91a9-74d64795575c None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:01.463692 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 15/28] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:42:01.469091 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f00ac-f870-4fe1-ad96-ee286c207f97 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:01.469599 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f00ac-f870-4fe1-ad96-ee286c207f97 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:01.470068 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f00ac-f870-4fe1-ad96-ee286c207f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:01.504164 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-a68f00ac-f870-4fe1-ad96-ee286c207f97 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:01.505715 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-a68f00ac-f870-4fe1-ad96-ee286c207f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:01.544434 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:01.572080 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd5f1d5-800d-4c7c-b538-15e78c8aa285 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:01.610374 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f7309-2a30-46dd-8213-85a752b4499b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:01.611039 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f7309-2a30-46dd-8213-85a752b4499b None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:01.611321 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f7309-2a30-46dd-8213-85a752b4499b None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:01.611593 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f7309-2a30-46dd-8213-85a752b4499b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:01.624443 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f7309-2a30-46dd-8213-85a752b4499b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:42:01.631012 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-b12f7309-2a30-46dd-8213-85a752b4499b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:42:01.631012 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:42:01.631012 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:42:01.631012 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:42:01.631012 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:42:01.631012 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:42:01.631012 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:42:01.631012 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:42:01.631012 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:42:01.631012 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:42:01.631012 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:42:01.631012 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:42:01.631012 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:42:01.631012 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:42:01.631012 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:42:01.631012 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:42:01.631887 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:42:01.631887 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:42:01.631887 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:42:01.631887 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:42:01.631887 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:42:01.631887 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:42:01.631887 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:42:01.631887 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:42:01.631887 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:42:01.631887 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:42:01.631887 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:42:01.631887 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:42:01.631887 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:42:01.631887 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:42:01.631887 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:42:01.631887 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:42:01.632700 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:42:01.632700 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:42:01.632700 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:42:01.632700 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:42:01.632700 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:42:01.632700 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:42:01.632700 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:42:01.632700 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:42:01.632700 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:42:01.632700 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:42:01.632700 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:42:01.632700 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:42:01.632700 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 14/29] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 23 00:42:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:42:01.633314 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f7309-2a30-46dd-8213-85a752b4499b None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:01.634666 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 16/30] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 00:42:01.638217 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f00ac-f870-4fe1-ad96-ee286c207f97 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:01.705080 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:01.735415 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f7309-2a30-46dd-8213-85a752b4499b None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:01.753695 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f00ac-f870-4fe1-ad96-ee286c207f97 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:01.770833 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec215bb7-383f-4893-9b71-662ac421b9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:01.771597 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec215bb7-383f-4893-9b71-662ac421b9fc None admin] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:01.771861 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec215bb7-383f-4893-9b71-662ac421b9fc None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:01.772252 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec215bb7-383f-4893-9b71-662ac421b9fc None admin] PATH_INFO: `/v3/roles` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:01.772948 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec215bb7-383f-4893-9b71-662ac421b9fc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:01.774446 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec215bb7-383f-4893-9b71-662ac421b9fc None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:01.794474 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:01.795493 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed70598-72ab-4e5b-971b-47937b01413f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:01.796382 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed70598-72ab-4e5b-971b-47937b01413f None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:01.796907 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed70598-72ab-4e5b-971b-47937b01413f None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:01.797384 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed70598-72ab-4e5b-971b-47937b01413f None admin] PATH_INFO: `/v3/roles` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:01.798347 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed70598-72ab-4e5b-971b-47937b01413f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:01.798922 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed70598-72ab-4e5b-971b-47937b01413f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:01.801415 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed70598-72ab-4e5b-971b-47937b01413f None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:01.811401 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 17/31] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 23 00:42:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:01.817070 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed70598-72ab-4e5b-971b-47937b01413f None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:01.926227 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 15/32] 10.222.0.23 () {60 vars in 1131 bytes} [Sun Oct 23 00:42:01 2022] POST /identity/v3/roles => generated 219 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:42:01.927433 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec215bb7-383f-4893-9b71-662ac421b9fc None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:01.930353 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed70598-72ab-4e5b-971b-47937b01413f None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:01.962551 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:01.974502 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2889a565-53dd-4cfc-9a00-71b8d7b21a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:01.982216 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889a565-53dd-4cfc-9a00-71b8d7b21a00 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:01.982216 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889a565-53dd-4cfc-9a00-71b8d7b21a00 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:01.982216 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889a565-53dd-4cfc-9a00-71b8d7b21a00 None admin] PATH_INFO: `/v3/users/39aa566fa6c64c41804fb6eefcbf0c20` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:01.982216 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2889a565-53dd-4cfc-9a00-71b8d7b21a00 None admin] RBAC: Authorizing `identity:get_user(user_id=39aa566fa6c64c41804fb6eefcbf0c20)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:01.984127 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2889a565-53dd-4cfc-9a00-71b8d7b21a00 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:01.986141 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 18/33] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 23 00:42:01 2022] GET /identity/v3/users/39aa566fa6c64c41804fb6eefcbf0c20 => generated 247 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:01.996357 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2889a565-53dd-4cfc-9a00-71b8d7b21a00 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:02.162534 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2889a565-53dd-4cfc-9a00-71b8d7b21a00 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:02.170360 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec215bb7-383f-4893-9b71-662ac421b9fc None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:02.199700 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225a50b-c66b-4660-a1f0-ed058794cf0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:02.200771 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225a50b-c66b-4660-a1f0-ed058794cf0f None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:02.201272 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225a50b-c66b-4660-a1f0-ed058794cf0f None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:02.201829 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225a50b-c66b-4660-a1f0-ed058794cf0f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:02.203182 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225a50b-c66b-4660-a1f0-ed058794cf0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:02.204866 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225a50b-c66b-4660-a1f0-ed058794cf0f None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:02.208085 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 19/34] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:42:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:42:02.209265 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225a50b-c66b-4660-a1f0-ed058794cf0f None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:02.211204 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8e2a5-3b18-44ad-b23d-4d0b017275ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:02.211821 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8e2a5-3b18-44ad-b23d-4d0b017275ae None admin] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:02.212101 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8e2a5-3b18-44ad-b23d-4d0b017275ae None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:02.212375 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8e2a5-3b18-44ad-b23d-4d0b017275ae None admin] PATH_INFO: `/v3/roles` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:02.213285 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8e2a5-3b18-44ad-b23d-4d0b017275ae None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:02.215250 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8e2a5-3b18-44ad-b23d-4d0b017275ae None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:02.235519 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 16/35] 10.222.0.23 () {60 vars in 1131 bytes} [Sun Oct 23 00:42:01 2022] POST /identity/v3/roles => generated 225 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:42:02.236513 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8e2a5-3b18-44ad-b23d-4d0b017275ae None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:02.291155 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:02.322538 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:02.343010 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225a50b-c66b-4660-a1f0-ed058794cf0f None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:02.363791 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8e2a5-3b18-44ad-b23d-4d0b017275ae None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:02.385926 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db436e7-2d28-416b-91b7-11e75667c58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:02.386965 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db436e7-2d28-416b-91b7-11e75667c58d None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:02.387479 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db436e7-2d28-416b-91b7-11e75667c58d None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:02.387972 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db436e7-2d28-416b-91b7-11e75667c58d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:02.401695 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0b0d3-ff3b-4bfb-b4fd-53ec6d72742c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:02.402269 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db436e7-2d28-416b-91b7-11e75667c58d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:02.402449 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0b0d3-ff3b-4bfb-b4fd-53ec6d72742c None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:02.402688 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0b0d3-ff3b-4bfb-b4fd-53ec6d72742c None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:02.402965 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0b0d3-ff3b-4bfb-b4fd-53ec6d72742c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:02.403709 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0b0d3-ff3b-4bfb-b4fd-53ec6d72742c None admin] RBAC: Adding query filter params (role.id=1e2073be75174689aa4fac29e674583d, scope.domain.id=default, user.id=39aa566fa6c64c41804fb6eefcbf0c20) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:02.404019 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0b0d3-ff3b-4bfb-b4fd-53ec6d72742c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:02.405037 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db436e7-2d28-416b-91b7-11e75667c58d None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:02.405672 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0b0d3-ff3b-4bfb-b4fd-53ec6d72742c None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:02.417014 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 17/36] 10.222.0.23 () {56 vars in 1322 bytes} [Sun Oct 23 00:42:02 2022] GET /identity/v3/role_assignments?user.id=39aa566fa6c64c41804fb6eefcbf0c20&scope.domain.id=default&role.id=1e2073be75174689aa4fac29e674583d => generated 530 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:02.423265 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-5db436e7-2d28-416b-91b7-11e75667c58d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:42:02.423265 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:42:02.423265 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:42:02.423265 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:42:02.423265 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:42:02.423265 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:42:02.423265 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:42:02.423265 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:42:02.423265 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:42:02.423265 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:42:02.423265 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:42:02.423265 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:42:02.423265 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:42:02.423265 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:42:02.423265 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:42:02.423265 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:42:02.426583 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:42:02.426583 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:42:02.426583 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:42:02.426583 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:42:02.426583 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:42:02.426583 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:42:02.426583 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:42:02.426583 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:42:02.426583 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:42:02.426583 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:42:02.426583 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:42:02.426583 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:42:02.426583 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:42:02.426583 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:42:02.426583 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:42:02.426583 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:42:02.426583 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:42:02.427383 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:42:02.427383 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:42:02.427383 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:42:02.428119 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 20/37] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:42:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:42:02.434602 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0b0d3-ff3b-4bfb-b4fd-53ec6d72742c None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:02.587919 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0b0d3-ff3b-4bfb-b4fd-53ec6d72742c None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:02.605962 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466078b-5388-4089-a232-17720be645c2 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:02.606642 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466078b-5388-4089-a232-17720be645c2 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:02.607256 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466078b-5388-4089-a232-17720be645c2 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:02.608950 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 21/38] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:42:02.615543 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:02.616042 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ca66f-9dd3-4304-acce-c1e0b8fe71e0 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:02.617337 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ca66f-9dd3-4304-acce-c1e0b8fe71e0 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:02.617886 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ca66f-9dd3-4304-acce-c1e0b8fe71e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:02.629334 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123ec0c-236b-44c7-9a7f-56c8a21490df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:02.629334 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123ec0c-236b-44c7-9a7f-56c8a21490df None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:02.629334 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123ec0c-236b-44c7-9a7f-56c8a21490df None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:02.629648 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123ec0c-236b-44c7-9a7f-56c8a21490df None admin] PATH_INFO: `/v3/domains` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:02.630338 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5123ec0c-236b-44c7-9a7f-56c8a21490df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:02.630645 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5123ec0c-236b-44c7-9a7f-56c8a21490df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:02.632125 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5123ec0c-236b-44c7-9a7f-56c8a21490df None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:02.646950 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 18/39] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:42:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:02.652686 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123ec0c-236b-44c7-9a7f-56c8a21490df None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:02.756930 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-a72ca66f-9dd3-4304-acce-c1e0b8fe71e0 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:02.758615 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-a72ca66f-9dd3-4304-acce-c1e0b8fe71e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:02.774731 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123ec0c-236b-44c7-9a7f-56c8a21490df None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:02.816471 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38baedb8-0e05-4978-9ebb-1297fe677fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:02.817146 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38baedb8-0e05-4978-9ebb-1297fe677fee None admin] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:02.817437 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38baedb8-0e05-4978-9ebb-1297fe677fee None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:02.817716 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38baedb8-0e05-4978-9ebb-1297fe677fee None admin] PATH_INFO: `/v3/projects` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:02.818498 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38baedb8-0e05-4978-9ebb-1297fe677fee None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:02.819967 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38baedb8-0e05-4978-9ebb-1297fe677fee None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:02.835872 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 22/40] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:42:02.858187 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 19/41] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Oct 23 00:42:02 2022] POST /identity/v3/projects => generated 301 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:42:02.892489 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68e842-e983-486b-957c-036a22479981 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:02.892775 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68e842-e983-486b-957c-036a22479981 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:02.893109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68e842-e983-486b-957c-036a22479981 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:02.896575 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 23/42] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:42:02.905365 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf466bfb-6e3a-4d66-a095-e4ee8156b8a5 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:02.905743 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf466bfb-6e3a-4d66-a095-e4ee8156b8a5 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:02.906040 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf466bfb-6e3a-4d66-a095-e4ee8156b8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:02.926542 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-cf466bfb-6e3a-4d66-a095-e4ee8156b8a5 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:02.928143 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-cf466bfb-6e3a-4d66-a095-e4ee8156b8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:02.961419 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:03.007143 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 20/43] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:42:03.116388 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68e842-e983-486b-957c-036a22479981 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:03.160723 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:03.220368 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68e842-e983-486b-957c-036a22479981 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:03.255109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d2ae9-8725-4101-ba0e-be0d0963ac68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:03.255724 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d2ae9-8725-4101-ba0e-be0d0963ac68 None admin] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:03.256009 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d2ae9-8725-4101-ba0e-be0d0963ac68 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:03.256285 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d2ae9-8725-4101-ba0e-be0d0963ac68 None admin] PATH_INFO: `/v3/roles` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:03.256956 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70d2ae9-8725-4101-ba0e-be0d0963ac68 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:03.258366 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70d2ae9-8725-4101-ba0e-be0d0963ac68 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:03.273042 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf466bfb-6e3a-4d66-a095-e4ee8156b8a5 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:03.275037 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 24/44] 10.222.0.23 () {60 vars in 1131 bytes} [Sun Oct 23 00:42:03 2022] POST /identity/v3/roles => generated 223 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:42:03.381167 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf466bfb-6e3a-4d66-a095-e4ee8156b8a5 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:03.417501 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ccb39c-02b9-41a8-af41-f1a89d5f65bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:03.418160 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ccb39c-02b9-41a8-af41-f1a89d5f65bd None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:03.418445 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ccb39c-02b9-41a8-af41-f1a89d5f65bd None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:03.418720 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ccb39c-02b9-41a8-af41-f1a89d5f65bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:03.419854 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ccb39c-02b9-41a8-af41-f1a89d5f65bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:03.421332 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ccb39c-02b9-41a8-af41-f1a89d5f65bd None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:03.422979 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 21/45] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:42:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:42:03.428680 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d2ae9-8725-4101-ba0e-be0d0963ac68 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:03.528460 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:03.531511 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d2ae9-8725-4101-ba0e-be0d0963ac68 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:03.564798 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576abf6-2de1-4540-ab42-326d791c1cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:03.565405 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576abf6-2de1-4540-ab42-326d791c1cfd None admin] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:03.566294 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576abf6-2de1-4540-ab42-326d791c1cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:03.566576 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576abf6-2de1-4540-ab42-326d791c1cfd None admin] PATH_INFO: `/v3/projects` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:03.567239 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5576abf6-2de1-4540-ab42-326d791c1cfd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:03.568687 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5576abf6-2de1-4540-ab42-326d791c1cfd None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:03.595416 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 25/46] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Oct 23 00:42:03 2022] POST /identity/v3/projects => generated 312 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:42:05.724055 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29125e9-7ffd-4b5f-8b52-ef6a14e08fb4 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:05.724571 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29125e9-7ffd-4b5f-8b52-ef6a14e08fb4 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:05.724658 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29125e9-7ffd-4b5f-8b52-ef6a14e08fb4 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:05.726037 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 22/47] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:42:05.731399 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c59a6-5c56-4ed0-9bb8-110ade2bcd63 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:05.731807 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c59a6-5c56-4ed0-9bb8-110ade2bcd63 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:05.731965 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c59a6-5c56-4ed0-9bb8-110ade2bcd63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:05.750498 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-6d0c59a6-5c56-4ed0-9bb8-110ade2bcd63 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:05.751694 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-6d0c59a6-5c56-4ed0-9bb8-110ade2bcd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:05.816920 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 26/48] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:42:06.085130 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29125e9-7ffd-4b5f-8b52-ef6a14e08fb4 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:06.119155 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:06.183857 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29125e9-7ffd-4b5f-8b52-ef6a14e08fb4 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:06.216752 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce95e8-8088-4507-b6ea-bc2ea50adbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:06.217366 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce95e8-8088-4507-b6ea-bc2ea50adbf1 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:06.217650 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce95e8-8088-4507-b6ea-bc2ea50adbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:06.217926 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce95e8-8088-4507-b6ea-bc2ea50adbf1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:06.219053 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce95e8-8088-4507-b6ea-bc2ea50adbf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:06.220499 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce95e8-8088-4507-b6ea-bc2ea50adbf1 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:06.222126 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 23/49] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:42:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:06.227923 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0c59a6-5c56-4ed0-9bb8-110ade2bcd63 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:06.306377 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:06.325091 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0c59a6-5c56-4ed0-9bb8-110ade2bcd63 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:06.358292 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad94f43f-08e3-40ce-a9b8-3a8e4949cb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:06.358829 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad94f43f-08e3-40ce-a9b8-3a8e4949cb23 None admin] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:06.359110 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad94f43f-08e3-40ce-a9b8-3a8e4949cb23 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:06.359384 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad94f43f-08e3-40ce-a9b8-3a8e4949cb23 None admin] PATH_INFO: `/v3/projects` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:06.360035 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad94f43f-08e3-40ce-a9b8-3a8e4949cb23 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:06.361485 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad94f43f-08e3-40ce-a9b8-3a8e4949cb23 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:06.386981 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 27/50] 10.222.0.23 () {60 vars in 1140 bytes} [Sun Oct 23 00:42:06 2022] POST /identity/v3/projects => generated 298 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:42:08.507692 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde536ed-c194-495b-b058-27f5648d11f4 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:08.508171 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde536ed-c194-495b-b058-27f5648d11f4 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:08.508171 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde536ed-c194-495b-b058-27f5648d11f4 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:08.509500 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 24/51] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:42:08.514764 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a1461-e987-414c-b1ab-08684fff9f48 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:08.515149 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a1461-e987-414c-b1ab-08684fff9f48 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:08.515331 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a1461-e987-414c-b1ab-08684fff9f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:08.533970 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-930a1461-e987-414c-b1ab-08684fff9f48 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:08.535787 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-930a1461-e987-414c-b1ab-08684fff9f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:08.600699 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 28/52] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:42:08.870099 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde536ed-c194-495b-b058-27f5648d11f4 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:08.971242 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde536ed-c194-495b-b058-27f5648d11f4 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:08.973254 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:09.005727 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35ef16-0b95-463d-9473-7f30f6f09b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:09.006374 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35ef16-0b95-463d-9473-7f30f6f09b37 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:09.006658 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35ef16-0b95-463d-9473-7f30f6f09b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:09.006934 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35ef16-0b95-463d-9473-7f30f6f09b37 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:09.008030 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f35ef16-0b95-463d-9473-7f30f6f09b37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:09.009491 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f35ef16-0b95-463d-9473-7f30f6f09b37 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:09.011078 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 25/53] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:42:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:09.016631 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a1461-e987-414c-b1ab-08684fff9f48 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:09.075690 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:09.113843 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a1461-e987-414c-b1ab-08684fff9f48 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:09.146976 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153cb80e-349c-4e3d-85d2-b11fac420f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:09.147513 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153cb80e-349c-4e3d-85d2-b11fac420f90 None admin] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:09.147796 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153cb80e-349c-4e3d-85d2-b11fac420f90 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:09.148068 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153cb80e-349c-4e3d-85d2-b11fac420f90 None admin] PATH_INFO: `/v3/users` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:09.148711 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153cb80e-349c-4e3d-85d2-b11fac420f90 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:09.150186 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153cb80e-349c-4e3d-85d2-b11fac420f90 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:09.175548 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 29/54] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 23 00:42:09 2022] POST /identity/v3/users => generated 275 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:42:12.323503 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a86df-06f4-49f5-9700-81c273c2fe6f None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:12.324470 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a86df-06f4-49f5-9700-81c273c2fe6f None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:12.324949 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a86df-06f4-49f5-9700-81c273c2fe6f None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:12.326582 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 26/55] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:42:12.331820 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea4549-3976-406d-bc34-46c4cf232d97 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:12.332224 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea4549-3976-406d-bc34-46c4cf232d97 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:12.332379 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea4549-3976-406d-bc34-46c4cf232d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:12.356333 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-beea4549-3976-406d-bc34-46c4cf232d97 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:12.357762 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-beea4549-3976-406d-bc34-46c4cf232d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:12.448832 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 30/56] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:42:12.556032 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a743f-d9a1-4687-bc6d-b014cc9eeb85 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:12.556032 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a743f-d9a1-4687-bc6d-b014cc9eeb85 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:12.556032 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a743f-d9a1-4687-bc6d-b014cc9eeb85 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:12.556032 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 27/57] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:42:12.561075 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7bb9f-1e9b-4872-84f7-73082466e8dd None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:12.561373 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7bb9f-1e9b-4872-84f7-73082466e8dd None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:12.561661 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7bb9f-1e9b-4872-84f7-73082466e8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:12.590495 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-7cd7bb9f-1e9b-4872-84f7-73082466e8dd None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:12.591702 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-7cd7bb9f-1e9b-4872-84f7-73082466e8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:12.662532 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:12.690357 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 31/58] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:42:12.748112 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e94d4-791d-43c1-9f8c-5f13675d7463 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:12.748112 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e94d4-791d-43c1-9f8c-5f13675d7463 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:12.748112 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e94d4-791d-43c1-9f8c-5f13675d7463 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:12.748112 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 28/59] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:42:12.763297 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35230c5-36c2-46d3-aa90-18da9dbdc6a8 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:12.763590 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35230c5-36c2-46d3-aa90-18da9dbdc6a8 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:12.764132 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35230c5-36c2-46d3-aa90-18da9dbdc6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:12.764305 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e94d4-791d-43c1-9f8c-5f13675d7463 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:12.791279 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-b35230c5-36c2-46d3-aa90-18da9dbdc6a8 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:12.794202 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-b35230c5-36c2-46d3-aa90-18da9dbdc6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:12.886931 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 32/60] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:42:12.888554 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91a735-a138-40db-93ae-48b0816803fa None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:12.889117 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91a735-a138-40db-93ae-48b0816803fa None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:12.889613 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91a735-a138-40db-93ae-48b0816803fa None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:12.891336 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 33/61] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:42:12.896931 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91eacb-479f-43d2-9112-f4a061fb1e84 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:12.897496 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91eacb-479f-43d2-9112-f4a061fb1e84 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:12.897975 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91eacb-479f-43d2-9112-f4a061fb1e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:12.923520 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-9b91eacb-479f-43d2-9112-f4a061fb1e84 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:12.925049 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-9b91eacb-479f-43d2-9112-f4a061fb1e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:12.946401 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e94d4-791d-43c1-9f8c-5f13675d7463 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:13.007663 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3df0b-c69b-406a-bbd7-8993033d9ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:13.008570 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3df0b-c69b-406a-bbd7-8993033d9ceb None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:13.009073 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3df0b-c69b-406a-bbd7-8993033d9ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:13.009695 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3df0b-c69b-406a-bbd7-8993033d9ceb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:13.021196 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e3df0b-c69b-406a-bbd7-8993033d9ceb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:42:13.026992 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-c0e3df0b-c69b-406a-bbd7-8993033d9ceb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:42:13.026992 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:42:13.026992 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:42:13.026992 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:42:13.026992 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:42:13.026992 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:42:13.026992 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:42:13.026992 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:42:13.026992 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:42:13.026992 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:42:13.026992 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:42:13.026992 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:42:13.026992 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:42:13.026992 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:42:13.026992 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:42:13.026992 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:42:13.027816 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:42:13.027816 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:42:13.027816 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:42:13.027816 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:42:13.027816 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:42:13.027816 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:42:13.027816 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:42:13.027816 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:42:13.027816 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:42:13.027816 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:42:13.027816 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:42:13.027816 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:42:13.027816 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:42:13.027816 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:42:13.027816 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:42:13.027816 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:42:13.028571 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:42:13.028571 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:42:13.028571 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:42:13.028571 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:42:13.028571 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:42:13.028571 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:42:13.028571 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:42:13.028571 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:42:13.028571 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:42:13.028571 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:42:13.028571 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:42:13.028571 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:42:13.030910 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 29/62] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 23 00:42:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:42:13.031881 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3df0b-c69b-406a-bbd7-8993033d9ceb None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:13.032052 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 34/63] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 00:42:13.037330 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91eacb-479f-43d2-9112-f4a061fb1e84 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:13.083648 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:13.118559 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:13.213017 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3df0b-c69b-406a-bbd7-8993033d9ceb None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:13.235013 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91eacb-479f-43d2-9112-f4a061fb1e84 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:13.273985 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8cdd9-03a9-4cd9-a9ed-aefd1b329773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:13.274938 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8cdd9-03a9-4cd9-a9ed-aefd1b329773 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:13.275372 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8cdd9-03a9-4cd9-a9ed-aefd1b329773 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:13.275814 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8cdd9-03a9-4cd9-a9ed-aefd1b329773 None admin] PATH_INFO: `/v3/roles` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:13.276787 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff8cdd9-03a9-4cd9-a9ed-aefd1b329773 None admin] RBAC: Adding query filter params (name=member) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:13.277250 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff8cdd9-03a9-4cd9-a9ed-aefd1b329773 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:13.278915 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff8cdd9-03a9-4cd9-a9ed-aefd1b329773 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:13.289112 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 35/64] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 23 00:42:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:13.290373 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8cdd9-03a9-4cd9-a9ed-aefd1b329773 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:13.379969 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b643ff6-1b04-4400-95e4-b67bcb5f7a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:13.380596 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b643ff6-1b04-4400-95e4-b67bcb5f7a8f None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:13.380885 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b643ff6-1b04-4400-95e4-b67bcb5f7a8f None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:13.381161 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b643ff6-1b04-4400-95e4-b67bcb5f7a8f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:13.391735 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b643ff6-1b04-4400-95e4-b67bcb5f7a8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:42:13.395731 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8cdd9-03a9-4cd9-a9ed-aefd1b329773 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:13.397252 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:13.397691 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-8b643ff6-1b04-4400-95e4-b67bcb5f7a8f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:42:13.397691 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:42:13.397691 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:42:13.397691 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:42:13.397691 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:42:13.397691 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:42:13.397691 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:42:13.397691 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:42:13.397691 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:42:13.397691 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:42:13.397691 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:42:13.397691 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:42:13.397691 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:42:13.397691 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:42:13.397691 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:42:13.397691 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:42:13.398779 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:42:13.398779 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:42:13.398779 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:42:13.398779 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:42:13.398779 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:42:13.398779 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:42:13.398779 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:42:13.398779 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:42:13.398779 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:42:13.398779 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:42:13.398779 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:42:13.398779 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:42:13.398779 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:42:13.398779 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:42:13.398779 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:42:13.398779 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:42:13.399701 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:42:13.399701 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:42:13.399701 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:42:13.399701 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:42:13.399701 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:42:13.399701 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:42:13.399701 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:42:13.399701 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:42:13.399701 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:42:13.399701 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:42:13.399701 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:42:13.399701 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:42:13.399701 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 30/65] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 23 00:42:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:42:13.404788 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b643ff6-1b04-4400-95e4-b67bcb5f7a8f None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:13.432737 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba8edb-a72f-4f4a-824c-38a0e05e9626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:13.433370 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba8edb-a72f-4f4a-824c-38a0e05e9626 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:13.433653 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba8edb-a72f-4f4a-824c-38a0e05e9626 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:13.433935 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba8edb-a72f-4f4a-824c-38a0e05e9626 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:13.443984 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba8edb-a72f-4f4a-824c-38a0e05e9626 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:42:13.449307 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-89ba8edb-a72f-4f4a-824c-38a0e05e9626 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 00:42:13.449307 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:42:13.449307 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:42:13.449307 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:42:13.449307 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:42:13.449307 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:42:13.449307 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:42:13.449307 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:42:13.449307 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:42:13.449307 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:42:13.449307 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:42:13.449307 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:42:13.449307 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:42:13.449307 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:42:13.449307 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:42:13.449307 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:42:13.450222 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:42:13.450222 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:42:13.450222 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:42:13.450222 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:42:13.450222 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:42:13.450222 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:42:13.450222 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:42:13.450222 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:42:13.450222 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:42:13.450222 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:42:13.450222 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:42:13.450222 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:42:13.450222 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:42:13.450222 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:42:13.450222 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:42:13.450222 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:42:13.450960 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:42:13.450960 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:42:13.450960 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:42:13.450960 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:42:13.450960 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:42:13.450960 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:42:13.450960 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:42:13.450960 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:42:13.450960 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:42:13.450960 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:42:13.450960 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 00:42:13.450960 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:42:13.450960 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 36/66] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 23 00:42:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:42:13.451568 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e96a3-3cac-433a-86a5-f55192374229 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:13.451843 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e96a3-3cac-433a-86a5-f55192374229 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:13.452174 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e96a3-3cac-433a-86a5-f55192374229 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:13.453354 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 37/67] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:42:13.454057 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e96a3-3cac-433a-86a5-f55192374229 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:13.498761 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:13.509898 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b643ff6-1b04-4400-95e4-b67bcb5f7a8f None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:13.543787 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de5a7d-eaf5-4ca5-802b-66d248e7c917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:13.544415 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de5a7d-eaf5-4ca5-802b-66d248e7c917 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:13.544703 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de5a7d-eaf5-4ca5-802b-66d248e7c917 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:13.544979 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de5a7d-eaf5-4ca5-802b-66d248e7c917 None admin] PATH_INFO: `/v3/users/72a99e5944964a5d98351e82622879c9` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:13.554537 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e96a3-3cac-433a-86a5-f55192374229 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:13.559701 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9de5a7d-eaf5-4ca5-802b-66d248e7c917 None admin] RBAC: Authorizing `identity:get_user(user_id=72a99e5944964a5d98351e82622879c9)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:13.561178 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9de5a7d-eaf5-4ca5-802b-66d248e7c917 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:13.562837 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 31/68] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 23 00:42:13 2022] GET /identity/v3/users/72a99e5944964a5d98351e82622879c9 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:13.563601 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de5a7d-eaf5-4ca5-802b-66d248e7c917 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:13.593058 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89924ae-af38-4513-8bea-a7c3e8c58f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:13.593686 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89924ae-af38-4513-8bea-a7c3e8c58f11 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:13.593967 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89924ae-af38-4513-8bea-a7c3e8c58f11 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:13.594270 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89924ae-af38-4513-8bea-a7c3e8c58f11 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:13.604817 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89924ae-af38-4513-8bea-a7c3e8c58f11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:42:13.609617 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-a89924ae-af38-4513-8bea-a7c3e8c58f11 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:42:13.609617 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:42:13.609617 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:42:13.609617 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:42:13.609617 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:42:13.609617 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:42:13.609617 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:42:13.609617 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:42:13.609617 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:42:13.609617 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:42:13.609617 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:42:13.609617 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:42:13.609617 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:42:13.609617 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:42:13.609617 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:42:13.609617 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:42:13.610665 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:42:13.610665 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:42:13.610665 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:42:13.610665 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:42:13.610665 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:42:13.610665 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:42:13.610665 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:42:13.610665 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:42:13.610665 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:42:13.610665 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:42:13.610665 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:42:13.610665 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:42:13.610665 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:42:13.610665 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:42:13.610665 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:42:13.610665 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:42:13.611516 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:42:13.611516 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:42:13.611516 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:42:13.611516 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:42:13.611516 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:42:13.611516 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:42:13.611516 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:42:13.611516 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:42:13.611516 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:42:13.611516 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:42:13.611516 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:42:13.611516 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:42:13.611516 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 38/69] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 23 00:42:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:42:13.611516 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89924ae-af38-4513-8bea-a7c3e8c58f11 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:13.635704 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:13.666836 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de5a7d-eaf5-4ca5-802b-66d248e7c917 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:13.699321 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb7334-88b4-4aa9-a0bb-2df21c43b027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:13.699921 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb7334-88b4-4aa9-a0bb-2df21c43b027 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:13.700203 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb7334-88b4-4aa9-a0bb-2df21c43b027 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:13.700484 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb7334-88b4-4aa9-a0bb-2df21c43b027 None admin] PATH_INFO: `/v3/roles` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:13.701140 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fb7334-88b4-4aa9-a0bb-2df21c43b027 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:13.701442 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fb7334-88b4-4aa9-a0bb-2df21c43b027 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:13.702841 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fb7334-88b4-4aa9-a0bb-2df21c43b027 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:13.710466 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89924ae-af38-4513-8bea-a7c3e8c58f11 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:13.715088 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 32/70] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 23 00:42:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:13.716089 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59d7ce-c6cb-4b19-96b3-f5143181f297 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:13.716372 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59d7ce-c6cb-4b19-96b3-f5143181f297 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:13.716647 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59d7ce-c6cb-4b19-96b3-f5143181f297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:13.733834 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-ab59d7ce-c6cb-4b19-96b3-f5143181f297 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:13.735036 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-ab59d7ce-c6cb-4b19-96b3-f5143181f297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:13.737818 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:13.748031 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50212b81-4473-4121-b952-8f7b1be58d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:13.748640 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50212b81-4473-4121-b952-8f7b1be58d6d None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:13.748968 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50212b81-4473-4121-b952-8f7b1be58d6d None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:13.749199 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50212b81-4473-4121-b952-8f7b1be58d6d None admin] PATH_INFO: `/v3/roles` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:13.749856 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50212b81-4473-4121-b952-8f7b1be58d6d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:13.750188 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50212b81-4473-4121-b952-8f7b1be58d6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:13.751576 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50212b81-4473-4121-b952-8f7b1be58d6d None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:13.759846 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 39/71] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 23 00:42:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:13.760609 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50212b81-4473-4121-b952-8f7b1be58d6d None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:13.805504 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 33/72] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:42:13.806366 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab59d7ce-c6cb-4b19-96b3-f5143181f297 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:13.856236 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:13.873311 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50212b81-4473-4121-b952-8f7b1be58d6d None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:13.908721 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d1977-27e0-40a4-8b23-cb61687c7534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:13.909348 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d1977-27e0-40a4-8b23-cb61687c7534 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:13.909627 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d1977-27e0-40a4-8b23-cb61687c7534 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:13.909926 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d1977-27e0-40a4-8b23-cb61687c7534 None admin] PATH_INFO: `/v3/projects/31a760413eac4b69bea4dd231b89ba6e` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:13.911084 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d1977-27e0-40a4-8b23-cb61687c7534 None admin] RBAC: Authorizing `identity:get_project(project_id=31a760413eac4b69bea4dd231b89ba6e)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:13.911193 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab59d7ce-c6cb-4b19-96b3-f5143181f297 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:13.912540 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d1977-27e0-40a4-8b23-cb61687c7534 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:13.914194 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 40/73] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 23 00:42:13 2022] GET /identity/v3/projects/31a760413eac4b69bea4dd231b89ba6e => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:13.919476 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d1977-27e0-40a4-8b23-cb61687c7534 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:13.946595 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b068bd02-3071-4baf-80bc-9515c6733afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:13.947202 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068bd02-3071-4baf-80bc-9515c6733afc None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:13.947476 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068bd02-3071-4baf-80bc-9515c6733afc None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:13.947756 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068bd02-3071-4baf-80bc-9515c6733afc None admin] PATH_INFO: `/v3/roles` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:13.948418 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b068bd02-3071-4baf-80bc-9515c6733afc None admin] RBAC: Adding query filter params (name=member) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:13.948721 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b068bd02-3071-4baf-80bc-9515c6733afc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:13.950133 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b068bd02-3071-4baf-80bc-9515c6733afc None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:13.962441 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 34/74] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 23 00:42:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:13.962441 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b068bd02-3071-4baf-80bc-9515c6733afc None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:13.965069 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:14.036264 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d1977-27e0-40a4-8b23-cb61687c7534 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:14.067551 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b068bd02-3071-4baf-80bc-9515c6733afc None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:14.072198 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43189c06-87b4-4026-9976-04bec5800fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:14.072834 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43189c06-87b4-4026-9976-04bec5800fc8 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:14.073116 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43189c06-87b4-4026-9976-04bec5800fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:14.073391 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43189c06-87b4-4026-9976-04bec5800fc8 None admin] PATH_INFO: `/v3/users/39aa566fa6c64c41804fb6eefcbf0c20` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:14.074545 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43189c06-87b4-4026-9976-04bec5800fc8 None admin] RBAC: Authorizing `identity:get_user(user_id=39aa566fa6c64c41804fb6eefcbf0c20)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:14.076005 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43189c06-87b4-4026-9976-04bec5800fc8 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:14.077604 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 41/75] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 23 00:42:13 2022] GET /identity/v3/users/39aa566fa6c64c41804fb6eefcbf0c20 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:14.078360 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43189c06-87b4-4026-9976-04bec5800fc8 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:14.101127 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:14.101274 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea241a-7fa6-4760-b239-edb7381836a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:14.101843 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea241a-7fa6-4760-b239-edb7381836a8 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:14.102176 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea241a-7fa6-4760-b239-edb7381836a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:14.102517 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea241a-7fa6-4760-b239-edb7381836a8 None admin] PATH_INFO: `/v3/users/72a99e5944964a5d98351e82622879c9` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:14.103878 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea241a-7fa6-4760-b239-edb7381836a8 None admin] RBAC: Authorizing `identity:get_user(user_id=72a99e5944964a5d98351e82622879c9)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:14.105361 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea241a-7fa6-4760-b239-edb7381836a8 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:14.107119 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 35/76] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 23 00:42:13 2022] GET /identity/v3/users/72a99e5944964a5d98351e82622879c9 => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:14.107805 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea241a-7fa6-4760-b239-edb7381836a8 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:14.178766 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:14.185178 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43189c06-87b4-4026-9976-04bec5800fc8 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:14.209842 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea241a-7fa6-4760-b239-edb7381836a8 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:14.218591 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544cf98-0aea-4ce8-b463-9a77bb09091e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:14.219253 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544cf98-0aea-4ce8-b463-9a77bb09091e None admin] REQUEST_METHOD: `PUT` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:14.219541 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544cf98-0aea-4ce8-b463-9a77bb09091e None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:14.219821 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544cf98-0aea-4ce8-b463-9a77bb09091e None admin] PATH_INFO: `/v3/projects/31a760413eac4b69bea4dd231b89ba6e/users/72a99e5944964a5d98351e82622879c9/roles/130c11043623491c8f8e67ecb6f3efbc` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:14.221747 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7544cf98-0aea-4ce8-b463-9a77bb09091e None admin] RBAC: Authorizing `identity:create_grant(project_id=31a760413eac4b69bea4dd231b89ba6e, user_id=72a99e5944964a5d98351e82622879c9, role_id=130c11043623491c8f8e67ecb6f3efbc)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:14.223801 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7544cf98-0aea-4ce8-b463-9a77bb09091e None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:14.236523 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 42/77] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 23 00:42:14 2022] PUT /identity/v3/projects/31a760413eac4b69bea4dd231b89ba6e/users/72a99e5944964a5d98351e82622879c9/roles/130c11043623491c8f8e67ecb6f3efbc => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:42:14.239203 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544cf98-0aea-4ce8-b463-9a77bb09091e None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:14.249110 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0aa8f5-9c05-4054-bc92-776d455b7f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:14.249776 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0aa8f5-9c05-4054-bc92-776d455b7f04 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:14.250088 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0aa8f5-9c05-4054-bc92-776d455b7f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:14.250404 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0aa8f5-9c05-4054-bc92-776d455b7f04 None admin] PATH_INFO: `/v3/users/72a99e5944964a5d98351e82622879c9` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:14.251674 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0aa8f5-9c05-4054-bc92-776d455b7f04 None admin] RBAC: Authorizing `identity:get_user(user_id=72a99e5944964a5d98351e82622879c9)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:14.253174 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0aa8f5-9c05-4054-bc92-776d455b7f04 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:14.255488 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 36/78] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 23 00:42:14 2022] GET /identity/v3/users/72a99e5944964a5d98351e82622879c9 => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:14.256310 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0aa8f5-9c05-4054-bc92-776d455b7f04 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:14.352444 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:14.372278 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0aa8f5-9c05-4054-bc92-776d455b7f04 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:14.377010 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544cf98-0aea-4ce8-b463-9a77bb09091e None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:14.413054 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b004b26-4317-4d72-be55-39aea75e2769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:14.413865 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b004b26-4317-4d72-be55-39aea75e2769 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:14.414179 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b004b26-4317-4d72-be55-39aea75e2769 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:14.414461 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b004b26-4317-4d72-be55-39aea75e2769 None admin] PATH_INFO: `/v3/projects/31a760413eac4b69bea4dd231b89ba6e` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:14.416063 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b004b26-4317-4d72-be55-39aea75e2769 None admin] RBAC: Authorizing `identity:get_project(project_id=31a760413eac4b69bea4dd231b89ba6e)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:14.417597 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b004b26-4317-4d72-be55-39aea75e2769 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:14.419380 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 37/79] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 23 00:42:14 2022] GET /identity/v3/projects/31a760413eac4b69bea4dd231b89ba6e => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:14.420289 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b004b26-4317-4d72-be55-39aea75e2769 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:14.423008 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0e92a-ba85-4d35-9ad5-150427f8806f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:14.423665 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0e92a-ba85-4d35-9ad5-150427f8806f None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:14.423946 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0e92a-ba85-4d35-9ad5-150427f8806f None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:14.424222 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0e92a-ba85-4d35-9ad5-150427f8806f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:14.425486 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a0e92a-ba85-4d35-9ad5-150427f8806f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:14.426964 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a0e92a-ba85-4d35-9ad5-150427f8806f None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:14.428736 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 43/80] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:42:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:14.429311 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0e92a-ba85-4d35-9ad5-150427f8806f None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:14.434454 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:14.534377 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0e92a-ba85-4d35-9ad5-150427f8806f None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:14.536204 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b004b26-4317-4d72-be55-39aea75e2769 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:14.570188 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e5b15-c8a0-471e-b924-b178ddc34e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:14.570829 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e5b15-c8a0-471e-b924-b178ddc34e14 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:14.571119 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e5b15-c8a0-471e-b924-b178ddc34e14 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:14.571395 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e5b15-c8a0-471e-b924-b178ddc34e14 None admin] PATH_INFO: `/v3/projects/ccb48d3ddf7e4b338b0d4782b7b814c5` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:14.572525 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523e5b15-c8a0-471e-b924-b178ddc34e14 None admin] RBAC: Authorizing `identity:get_project(project_id=ccb48d3ddf7e4b338b0d4782b7b814c5)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:14.574002 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523e5b15-c8a0-471e-b924-b178ddc34e14 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:14.574344 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4fa4a-cd48-4c4c-909c-b557b2efda2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:14.574979 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4fa4a-cd48-4c4c-909c-b557b2efda2b None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:14.575264 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4fa4a-cd48-4c4c-909c-b557b2efda2b None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:14.575543 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4fa4a-cd48-4c4c-909c-b557b2efda2b None admin] PATH_INFO: `/v3/projects/31a760413eac4b69bea4dd231b89ba6e` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:14.575692 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 44/81] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 23 00:42:14 2022] GET /identity/v3/projects/ccb48d3ddf7e4b338b0d4782b7b814c5 => generated 312 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:14.576513 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e5b15-c8a0-471e-b924-b178ddc34e14 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:14.581325 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c4fa4a-cd48-4c4c-909c-b557b2efda2b None admin] RBAC: Authorizing `identity:get_project(project_id=31a760413eac4b69bea4dd231b89ba6e)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:14.582867 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c4fa4a-cd48-4c4c-909c-b557b2efda2b None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:14.584681 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 38/82] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 23 00:42:14 2022] GET /identity/v3/projects/31a760413eac4b69bea4dd231b89ba6e => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:14.585298 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4fa4a-cd48-4c4c-909c-b557b2efda2b None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:14.595287 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:14.671911 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:14.687056 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e5b15-c8a0-471e-b924-b178ddc34e14 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:14.700490 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4fa4a-cd48-4c4c-909c-b557b2efda2b None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:14.726934 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d0521-4a05-4e1f-a7c0-bbf67408c867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:14.727607 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d0521-4a05-4e1f-a7c0-bbf67408c867 None admin] REQUEST_METHOD: `PUT` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:14.727903 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d0521-4a05-4e1f-a7c0-bbf67408c867 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:14.728453 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d0521-4a05-4e1f-a7c0-bbf67408c867 None admin] PATH_INFO: `/v3/projects/31a760413eac4b69bea4dd231b89ba6e/users/39aa566fa6c64c41804fb6eefcbf0c20/roles/1e2073be75174689aa4fac29e674583d` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:14.730697 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05d0521-4a05-4e1f-a7c0-bbf67408c867 None admin] RBAC: Authorizing `identity:create_grant(project_id=31a760413eac4b69bea4dd231b89ba6e, user_id=39aa566fa6c64c41804fb6eefcbf0c20, role_id=1e2073be75174689aa4fac29e674583d)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:14.732179 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05d0521-4a05-4e1f-a7c0-bbf67408c867 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:14.737805 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f363c-4df1-4052-a895-6db3353ff942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:14.739060 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f363c-4df1-4052-a895-6db3353ff942 None admin] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:14.739422 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f363c-4df1-4052-a895-6db3353ff942 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:14.739812 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f363c-4df1-4052-a895-6db3353ff942 None admin] PATH_INFO: `/v3/users` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:14.740608 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5f363c-4df1-4052-a895-6db3353ff942 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:14.742209 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5f363c-4df1-4052-a895-6db3353ff942 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:14.747318 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 45/83] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 23 00:42:14 2022] PUT /identity/v3/projects/31a760413eac4b69bea4dd231b89ba6e/users/39aa566fa6c64c41804fb6eefcbf0c20/roles/1e2073be75174689aa4fac29e674583d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:42:14.748115 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d0521-4a05-4e1f-a7c0-bbf67408c867 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:14.790306 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 39/84] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 23 00:42:14 2022] POST /identity/v3/users => generated 289 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:42:14.791820 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f363c-4df1-4052-a895-6db3353ff942 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:14.846544 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:14.877279 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d0521-4a05-4e1f-a7c0-bbf67408c867 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:14.919991 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25a7f9-4a51-46ad-8f95-dc30eaac2245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:14.921183 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25a7f9-4a51-46ad-8f95-dc30eaac2245 None admin] REQUEST_METHOD: `PUT` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:14.921699 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25a7f9-4a51-46ad-8f95-dc30eaac2245 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:14.922270 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25a7f9-4a51-46ad-8f95-dc30eaac2245 None admin] PATH_INFO: `/v3/projects/ccb48d3ddf7e4b338b0d4782b7b814c5/users/72a99e5944964a5d98351e82622879c9/roles/130c11043623491c8f8e67ecb6f3efbc` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:14.924961 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25a7f9-4a51-46ad-8f95-dc30eaac2245 None admin] RBAC: Authorizing `identity:create_grant(project_id=ccb48d3ddf7e4b338b0d4782b7b814c5, user_id=72a99e5944964a5d98351e82622879c9, role_id=130c11043623491c8f8e67ecb6f3efbc)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:14.927351 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25a7f9-4a51-46ad-8f95-dc30eaac2245 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:14.927896 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f363c-4df1-4052-a895-6db3353ff942 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:14.948243 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 46/85] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 23 00:42:14 2022] PUT /identity/v3/projects/ccb48d3ddf7e4b338b0d4782b7b814c5/users/72a99e5944964a5d98351e82622879c9/roles/130c11043623491c8f8e67ecb6f3efbc => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:42:14.967649 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:14.978940 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b789a79-79cd-41e6-b951-317518b834e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:14.979652 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b789a79-79cd-41e6-b951-317518b834e0 None admin] REQUEST_METHOD: `PUT` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:14.979939 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b789a79-79cd-41e6-b951-317518b834e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:14.980301 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b789a79-79cd-41e6-b951-317518b834e0 None admin] PATH_INFO: `/v3/projects/31a760413eac4b69bea4dd231b89ba6e/users/72a99e5944964a5d98351e82622879c9/roles/9f802c7a3366414c9d0ee9e7a4cb5b74` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:14.983099 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b789a79-79cd-41e6-b951-317518b834e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=31a760413eac4b69bea4dd231b89ba6e, user_id=72a99e5944964a5d98351e82622879c9, role_id=9f802c7a3366414c9d0ee9e7a4cb5b74)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:14.984760 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b789a79-79cd-41e6-b951-317518b834e0 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:15.006372 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 40/86] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 23 00:42:14 2022] PUT /identity/v3/projects/31a760413eac4b69bea4dd231b89ba6e/users/72a99e5944964a5d98351e82622879c9/roles/9f802c7a3366414c9d0ee9e7a4cb5b74 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:42:17.283232 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523134f2-6271-4db2-ad38-06767e669e34 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:17.284083 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523134f2-6271-4db2-ad38-06767e669e34 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:17.284513 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523134f2-6271-4db2-ad38-06767e669e34 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:17.286652 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 47/87] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:42:17.303336 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f76b1-c182-456f-803c-0b48a948ff82 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:17.304205 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f76b1-c182-456f-803c-0b48a948ff82 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:17.304637 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f76b1-c182-456f-803c-0b48a948ff82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:17.331782 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-a76f76b1-c182-456f-803c-0b48a948ff82 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:17.333307 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-a76f76b1-c182-456f-803c-0b48a948ff82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:17.419472 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db22cd-f58b-4b82-9c01-006618395563 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:17.419755 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db22cd-f58b-4b82-9c01-006618395563 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:17.420020 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db22cd-f58b-4b82-9c01-006618395563 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:17.421859 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 48/88] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:42:17.422642 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 41/89] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:42:17.427707 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1c8e1-10f8-42b6-be02-3779da684ee4 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:17.427994 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1c8e1-10f8-42b6-be02-3779da684ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:17.428275 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1c8e1-10f8-42b6-be02-3779da684ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:17.458390 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-86a1c8e1-10f8-42b6-be02-3779da684ee4 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:17.459657 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-86a1c8e1-10f8-42b6-be02-3779da684ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:17.558762 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 49/90] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 00:42:17.727289 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f76b1-c182-456f-803c-0b48a948ff82 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:17.764917 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e275a-310f-4b25-9be1-fe8abdb63490 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:17.765259 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e275a-310f-4b25-9be1-fe8abdb63490 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:17.765474 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e275a-310f-4b25-9be1-fe8abdb63490 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:17.766999 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 50/91] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:42:17.786981 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52af265-da0a-4bc1-aefb-2ebb49b3ef5e None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:17.787276 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52af265-da0a-4bc1-aefb-2ebb49b3ef5e None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:17.787528 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52af265-da0a-4bc1-aefb-2ebb49b3ef5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:17.814267 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-f52af265-da0a-4bc1-aefb-2ebb49b3ef5e None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:17.815370 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-f52af265-da0a-4bc1-aefb-2ebb49b3ef5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:17.908342 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f76b1-c182-456f-803c-0b48a948ff82 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:17.950198 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:17.954109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:17.963689 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 51/92] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 00:42:17.964388 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52af265-da0a-4bc1-aefb-2ebb49b3ef5e None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:17.983168 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853fdb7-dae6-4c53-8819-f1ae211555fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:17.983818 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853fdb7-dae6-4c53-8819-f1ae211555fd None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:17.984106 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853fdb7-dae6-4c53-8819-f1ae211555fd None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:17.984388 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853fdb7-dae6-4c53-8819-f1ae211555fd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:18.026442 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853fdb7-dae6-4c53-8819-f1ae211555fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:42:18.031363 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-8853fdb7-dae6-4c53-8819-f1ae211555fd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:42:18.031363 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:42:18.031363 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:42:18.031363 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:42:18.031363 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:42:18.031363 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:42:18.031363 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:42:18.031363 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:42:18.031363 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:42:18.031363 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:42:18.031363 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:42:18.031363 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:42:18.031363 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:42:18.031363 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:42:18.031363 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:42:18.031363 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:42:18.032184 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:42:18.032184 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:42:18.032184 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:42:18.032184 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:42:18.032184 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:42:18.032184 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:42:18.032184 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:42:18.032184 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:42:18.032184 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:42:18.032184 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:42:18.032184 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:42:18.032184 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:42:18.032184 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:42:18.032184 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:42:18.032184 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:42:18.032184 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:42:18.032913 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:42:18.032913 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:42:18.032913 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:42:18.032913 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:42:18.032913 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:42:18.032913 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:42:18.032913 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:42:18.032913 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:42:18.032913 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:42:18.032913 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:42:18.032913 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:42:18.032913 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:42:18.038264 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 42/93] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 23 00:42:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:42:18.039119 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853fdb7-dae6-4c53-8819-f1ae211555fd None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:18.225608 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52af265-da0a-4bc1-aefb-2ebb49b3ef5e None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:18.272151 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853fdb7-dae6-4c53-8819-f1ae211555fd None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:18.304429 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70379a48-1553-4782-8f76-049f7e246a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:18.305100 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70379a48-1553-4782-8f76-049f7e246a2f None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:18.305355 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70379a48-1553-4782-8f76-049f7e246a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:18.305632 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70379a48-1553-4782-8f76-049f7e246a2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:18.322593 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70379a48-1553-4782-8f76-049f7e246a2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:42:18.323060 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb8032-273e-4bf9-8b6e-bfef6b30696e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:18.323680 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb8032-273e-4bf9-8b6e-bfef6b30696e None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:18.323967 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb8032-273e-4bf9-8b6e-bfef6b30696e None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:18.324249 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb8032-273e-4bf9-8b6e-bfef6b30696e None admin] PATH_INFO: `/v3/roles` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:18.324918 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bb8032-273e-4bf9-8b6e-bfef6b30696e None admin] RBAC: Adding query filter params (name=member) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:18.325225 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bb8032-273e-4bf9-8b6e-bfef6b30696e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:18.326667 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bb8032-273e-4bf9-8b6e-bfef6b30696e None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:18.329574 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-70379a48-1553-4782-8f76-049f7e246a2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:42:18.329574 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:42:18.329574 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:42:18.329574 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:42:18.329574 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:42:18.329574 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:42:18.329574 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:42:18.329574 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:42:18.329574 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:42:18.329574 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:42:18.329574 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:42:18.329574 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:42:18.329574 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:42:18.329574 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:42:18.329574 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:42:18.329574 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:42:18.330601 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:42:18.330601 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:42:18.330601 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:42:18.330601 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:42:18.330601 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:42:18.330601 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:42:18.330601 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:42:18.330601 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:42:18.330601 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:42:18.330601 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:42:18.330601 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:42:18.330601 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:42:18.330601 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:42:18.330601 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:42:18.330601 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:42:18.330601 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:42:18.331541 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:42:18.331541 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:42:18.331541 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:42:18.331541 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:42:18.331541 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:42:18.331541 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:42:18.331541 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:42:18.331541 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:42:18.331541 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:42:18.331541 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:42:18.331541 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:42:18.331541 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:42:18.333493 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 52/94] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 23 00:42:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:42:18.335506 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 43/95] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 23 00:42:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:42:18.336673 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb8032-273e-4bf9-8b6e-bfef6b30696e None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:18.339874 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e54e2-f0dc-471b-a301-5cf89c853e49 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:18.340555 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e54e2-f0dc-471b-a301-5cf89c853e49 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:18.340997 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e54e2-f0dc-471b-a301-5cf89c853e49 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:18.343055 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 53/96] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:18 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:42:18.344092 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e54e2-f0dc-471b-a301-5cf89c853e49 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:18.387100 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:18.409213 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:18.445537 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb8032-273e-4bf9-8b6e-bfef6b30696e None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:18.457961 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e54e2-f0dc-471b-a301-5cf89c853e49 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:18.481197 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d3123-071d-44b9-8a08-abf6a2aff46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:18.481760 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d3123-071d-44b9-8a08-abf6a2aff46a None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:18.482055 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d3123-071d-44b9-8a08-abf6a2aff46a None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:18.482359 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d3123-071d-44b9-8a08-abf6a2aff46a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:18.493480 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3d3123-071d-44b9-8a08-abf6a2aff46a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:42:18.493977 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f70f7-3502-4d21-bb05-8294c2a94f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:18.494636 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f70f7-3502-4d21-bb05-8294c2a94f82 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:18.494923 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f70f7-3502-4d21-bb05-8294c2a94f82 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:18.495200 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f70f7-3502-4d21-bb05-8294c2a94f82 None admin] PATH_INFO: `/v3/users/72a99e5944964a5d98351e82622879c9` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:18.496335 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f70f7-3502-4d21-bb05-8294c2a94f82 None admin] RBAC: Authorizing `identity:get_user(user_id=72a99e5944964a5d98351e82622879c9)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:18.497789 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f70f7-3502-4d21-bb05-8294c2a94f82 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:18.499429 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 54/97] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 23 00:42:18 2022] GET /identity/v3/users/72a99e5944964a5d98351e82622879c9 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:18.500214 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f70f7-3502-4d21-bb05-8294c2a94f82 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:18.500432 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-2d3d3123-071d-44b9-8a08-abf6a2aff46a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:42:18.500432 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:42:18.500432 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:42:18.500432 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:42:18.500432 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:42:18.500432 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:42:18.500432 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:42:18.500432 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:42:18.500432 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:42:18.500432 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:42:18.500432 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:42:18.500432 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:42:18.500432 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:42:18.500432 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:42:18.500432 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:42:18.500432 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:42:18.501268 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:42:18.501268 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:42:18.501268 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:42:18.501268 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:42:18.501268 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:42:18.501268 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:42:18.501268 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:42:18.501268 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:42:18.501268 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:42:18.501268 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:42:18.501268 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:42:18.501268 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:42:18.501268 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:42:18.501268 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:42:18.501268 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:42:18.501268 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:42:18.502009 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:42:18.502009 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:42:18.502009 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:42:18.502009 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:42:18.502009 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:42:18.502009 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:42:18.502009 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:42:18.502009 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:42:18.502009 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:42:18.502009 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:42:18.502009 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:42:18.502009 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:42:18.502009 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 44/98] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 23 00:42:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:42:18.503233 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb3d80-1d81-456f-83c2-04f5eb2618ea None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:18.503233 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb3d80-1d81-456f-83c2-04f5eb2618ea None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:18.503388 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb3d80-1d81-456f-83c2-04f5eb2618ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:18.522790 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-83fb3d80-1d81-456f-83c2-04f5eb2618ea None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:18.523995 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-83fb3d80-1d81-456f-83c2-04f5eb2618ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:18.595115 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 45/99] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:42:18.596789 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af4c96-d01a-4162-ad89-c2c2b16a23be None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:18.597090 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af4c96-d01a-4162-ad89-c2c2b16a23be None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:18.597369 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af4c96-d01a-4162-ad89-c2c2b16a23be None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:18.599360 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 46/100] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:42:18.599991 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af4c96-d01a-4162-ad89-c2c2b16a23be None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:18.636142 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f70f7-3502-4d21-bb05-8294c2a94f82 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:18.637169 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:18.667929 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:18.681680 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f6e87-f881-4c3e-8475-3bb24be38426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:18.682865 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f6e87-f881-4c3e-8475-3bb24be38426 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:18.683401 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f6e87-f881-4c3e-8475-3bb24be38426 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:18.684003 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f6e87-f881-4c3e-8475-3bb24be38426 None admin] PATH_INFO: `/v3/roles` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:18.685659 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f6e87-f881-4c3e-8475-3bb24be38426 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:18.686206 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f6e87-f881-4c3e-8475-3bb24be38426 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:18.687810 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f6e87-f881-4c3e-8475-3bb24be38426 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:18.698766 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 55/101] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 23 00:42:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:18.699820 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f6e87-f881-4c3e-8475-3bb24be38426 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:18.723322 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af4c96-d01a-4162-ad89-c2c2b16a23be None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:18.761218 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974eee50-158e-4c01-b37e-0357b5e1e9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:18.761759 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974eee50-158e-4c01-b37e-0357b5e1e9d4 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:18.762038 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974eee50-158e-4c01-b37e-0357b5e1e9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:18.762343 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974eee50-158e-4c01-b37e-0357b5e1e9d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:18.822966 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f6e87-f881-4c3e-8475-3bb24be38426 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:18.848538 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974eee50-158e-4c01-b37e-0357b5e1e9d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:18.850228 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974eee50-158e-4c01-b37e-0357b5e1e9d4 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:18.868500 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca87b5f-854b-4b68-8d5e-4fef9df44917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:18.869131 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca87b5f-854b-4b68-8d5e-4fef9df44917 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:18.869417 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca87b5f-854b-4b68-8d5e-4fef9df44917 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:18.869698 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca87b5f-854b-4b68-8d5e-4fef9df44917 None admin] PATH_INFO: `/v3/roles` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:18.870410 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca87b5f-854b-4b68-8d5e-4fef9df44917 None admin] RBAC: Adding query filter params (name=member) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:18.870720 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca87b5f-854b-4b68-8d5e-4fef9df44917 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:18.872136 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca87b5f-854b-4b68-8d5e-4fef9df44917 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:18.882247 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 56/102] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 23 00:42:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:18.882577 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a896811-d3d5-4130-80e3-bd5b32b1c6d9 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:18.882881 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a896811-d3d5-4130-80e3-bd5b32b1c6d9 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:18.883166 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a896811-d3d5-4130-80e3-bd5b32b1c6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:18.887002 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:18.903456 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-5a896811-d3d5-4130-80e3-bd5b32b1c6d9 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:18.904711 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-5a896811-d3d5-4130-80e3-bd5b32b1c6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:18.950825 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:18.963187 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 47/103] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 23 00:42:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 00:42:18.964042 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974eee50-158e-4c01-b37e-0357b5e1e9d4 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:18.975989 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 57/104] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:42:18.976828 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a896811-d3d5-4130-80e3-bd5b32b1c6d9 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:19.075554 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974eee50-158e-4c01-b37e-0357b5e1e9d4 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:19.077957 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a896811-d3d5-4130-80e3-bd5b32b1c6d9 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:19.106779 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:19.112303 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f0828-9fcc-4953-98ac-a07bc08acca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:19.112943 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f0828-9fcc-4953-98ac-a07bc08acca8 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:19.113778 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f0828-9fcc-4953-98ac-a07bc08acca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:19.113877 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6fc7e-72ec-48a7-bd92-af98393f6b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:19.114062 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f0828-9fcc-4953-98ac-a07bc08acca8 None admin] PATH_INFO: `/v3/users/39aa566fa6c64c41804fb6eefcbf0c20` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:19.114500 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6fc7e-72ec-48a7-bd92-af98393f6b1c None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:19.114780 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6fc7e-72ec-48a7-bd92-af98393f6b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:19.115057 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6fc7e-72ec-48a7-bd92-af98393f6b1c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:19.115310 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836f0828-9fcc-4953-98ac-a07bc08acca8 None admin] RBAC: Authorizing `identity:get_user(user_id=39aa566fa6c64c41804fb6eefcbf0c20)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:19.116898 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836f0828-9fcc-4953-98ac-a07bc08acca8 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:19.118849 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 48/105] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 23 00:42:18 2022] GET /identity/v3/users/39aa566fa6c64c41804fb6eefcbf0c20 => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:19.124061 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f0828-9fcc-4953-98ac-a07bc08acca8 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:19.125205 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6fc7e-72ec-48a7-bd92-af98393f6b1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:42:19.131766 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-fcb6fc7e-72ec-48a7-bd92-af98393f6b1c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 00:42:19.131766 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:42:19.131766 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:42:19.131766 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:42:19.131766 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:42:19.131766 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:42:19.131766 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:42:19.131766 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:42:19.131766 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:42:19.131766 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:42:19.131766 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:42:19.131766 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:42:19.131766 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:42:19.131766 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:42:19.131766 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:42:19.131766 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:42:19.132601 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:42:19.132601 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:42:19.132601 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:42:19.132601 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:42:19.132601 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:42:19.132601 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:42:19.132601 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:42:19.132601 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:42:19.132601 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:42:19.132601 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:42:19.132601 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:42:19.132601 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:42:19.132601 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:42:19.132601 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:42:19.132601 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:42:19.132601 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:42:19.133468 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:42:19.133468 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:42:19.133468 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:42:19.133468 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:42:19.133468 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:42:19.133468 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:42:19.133468 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:42:19.133468 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:42:19.133468 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:42:19.133468 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:42:19.133468 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 00:42:19.133468 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:42:19.133468 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 58/106] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 23 00:42:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:42:19.139553 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027c8cb-4d9e-4715-9ece-465e7e24c637 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:19.139553 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027c8cb-4d9e-4715-9ece-465e7e24c637 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:19.139553 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027c8cb-4d9e-4715-9ece-465e7e24c637 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:19.139553 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 59/107] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:42:19.141667 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027c8cb-4d9e-4715-9ece-465e7e24c637 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:19.182455 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:19.235212 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f0828-9fcc-4953-98ac-a07bc08acca8 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:19.246946 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027c8cb-4d9e-4715-9ece-465e7e24c637 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:19.273240 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b08f4-a1ef-4fcc-8e28-62e56b9f4d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:19.273867 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b08f4-a1ef-4fcc-8e28-62e56b9f4d60 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:19.274180 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b08f4-a1ef-4fcc-8e28-62e56b9f4d60 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:19.274460 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b08f4-a1ef-4fcc-8e28-62e56b9f4d60 None admin] PATH_INFO: `/v3/users/72a99e5944964a5d98351e82622879c9` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:19.275581 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b08f4-a1ef-4fcc-8e28-62e56b9f4d60 None admin] RBAC: Authorizing `identity:get_user(user_id=72a99e5944964a5d98351e82622879c9)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:19.277074 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b08f4-a1ef-4fcc-8e28-62e56b9f4d60 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:19.278688 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 49/108] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 23 00:42:19 2022] GET /identity/v3/users/72a99e5944964a5d98351e82622879c9 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:19.279447 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b08f4-a1ef-4fcc-8e28-62e56b9f4d60 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:19.284812 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefda619-d1f6-4258-924f-1e48e52d3281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:19.285478 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefda619-d1f6-4258-924f-1e48e52d3281 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:19.285764 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefda619-d1f6-4258-924f-1e48e52d3281 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:19.286042 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefda619-d1f6-4258-924f-1e48e52d3281 None admin] PATH_INFO: `/v3/projects/31a760413eac4b69bea4dd231b89ba6e` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:19.287197 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefda619-d1f6-4258-924f-1e48e52d3281 None admin] RBAC: Authorizing `identity:get_project(project_id=31a760413eac4b69bea4dd231b89ba6e)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:19.288673 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefda619-d1f6-4258-924f-1e48e52d3281 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:19.294893 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 60/109] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 23 00:42:19 2022] GET /identity/v3/projects/31a760413eac4b69bea4dd231b89ba6e => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:19.294893 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefda619-d1f6-4258-924f-1e48e52d3281 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:19.350438 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:19.384160 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b08f4-a1ef-4fcc-8e28-62e56b9f4d60 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:19.391793 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefda619-d1f6-4258-924f-1e48e52d3281 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:19.398927 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:19.417116 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f55e81-2374-4826-853b-239822addc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:19.417721 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f55e81-2374-4826-853b-239822addc44 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:19.418006 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f55e81-2374-4826-853b-239822addc44 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:19.418313 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f55e81-2374-4826-853b-239822addc44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:19.425534 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447ab2d-cb4a-4f78-81ba-4d28be6fb869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:19.426696 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447ab2d-cb4a-4f78-81ba-4d28be6fb869 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:19.426983 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447ab2d-cb4a-4f78-81ba-4d28be6fb869 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:19.427259 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447ab2d-cb4a-4f78-81ba-4d28be6fb869 None admin] PATH_INFO: `/v3/roles` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:19.427924 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447ab2d-cb4a-4f78-81ba-4d28be6fb869 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:19.428231 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447ab2d-cb4a-4f78-81ba-4d28be6fb869 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:19.429624 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447ab2d-cb4a-4f78-81ba-4d28be6fb869 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:19.437494 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 61/110] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 23 00:42:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:19.438651 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48a504-88eb-4421-943d-808e2f06117c None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:19.438941 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48a504-88eb-4421-943d-808e2f06117c None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:19.439223 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48a504-88eb-4421-943d-808e2f06117c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:19.456703 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-5e48a504-88eb-4421-943d-808e2f06117c None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:19.457903 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-5e48a504-88eb-4421-943d-808e2f06117c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:19.489659 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f55e81-2374-4826-853b-239822addc44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:19.491242 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f55e81-2374-4826-853b-239822addc44 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:19.523106 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 62/111] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:42:19.526926 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e48a504-88eb-4421-943d-808e2f06117c None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:19.559657 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:19.597419 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 50/112] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 23 00:42:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 00:42:19.603734 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f55e81-2374-4826-853b-239822addc44 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:19.624191 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:19.628286 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e48a504-88eb-4421-943d-808e2f06117c None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:19.666645 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a6e2d-340b-41cb-91e7-14fb07f214dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:19.667280 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a6e2d-340b-41cb-91e7-14fb07f214dc None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:19.667572 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a6e2d-340b-41cb-91e7-14fb07f214dc None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:19.667851 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a6e2d-340b-41cb-91e7-14fb07f214dc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:19.679351 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a6e2d-340b-41cb-91e7-14fb07f214dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:42:19.684219 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-e62a6e2d-340b-41cb-91e7-14fb07f214dc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 00:42:19.684219 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:42:19.684219 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:42:19.684219 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:42:19.684219 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:42:19.684219 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:42:19.684219 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:42:19.684219 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:42:19.684219 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:42:19.684219 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:42:19.684219 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:42:19.684219 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:42:19.684219 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:42:19.684219 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:42:19.684219 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:42:19.684219 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:42:19.685057 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:42:19.685057 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:42:19.685057 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:42:19.685057 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:42:19.685057 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:42:19.685057 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:42:19.685057 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:42:19.685057 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:42:19.685057 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:42:19.685057 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:42:19.685057 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:42:19.685057 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:42:19.685057 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:42:19.685057 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:42:19.685057 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:42:19.685057 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:42:19.686803 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:42:19.686803 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:42:19.686803 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:42:19.686803 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:42:19.686803 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:42:19.686803 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:42:19.686803 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:42:19.686803 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:42:19.686803 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:42:19.686803 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:42:19.686803 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 00:42:19.686803 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:42:19.686803 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 63/113] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 23 00:42:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:42:19.686803 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a6e2d-340b-41cb-91e7-14fb07f214dc None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:19.715664 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f55e81-2374-4826-853b-239822addc44 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:19.762443 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c8c52-b25a-4dd5-9191-d72cac66dc0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:19.763051 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c8c52-b25a-4dd5-9191-d72cac66dc0f None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:19.763342 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c8c52-b25a-4dd5-9191-d72cac66dc0f None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:19.763609 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c8c52-b25a-4dd5-9191-d72cac66dc0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:19.791980 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a6e2d-340b-41cb-91e7-14fb07f214dc None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:19.800506 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:19.826575 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5b8f5-b2d0-483d-bff6-815c222de21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:19.827191 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5b8f5-b2d0-483d-bff6-815c222de21c None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:19.827476 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5b8f5-b2d0-483d-bff6-815c222de21c None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:19.827755 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5b8f5-b2d0-483d-bff6-815c222de21c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:19.828493 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf5b8f5-b2d0-483d-bff6-815c222de21c None admin] RBAC: Adding query filter params (role.id=130c11043623491c8f8e67ecb6f3efbc, scope.project.id=31a760413eac4b69bea4dd231b89ba6e, user.id=72a99e5944964a5d98351e82622879c9) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:19.828803 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf5b8f5-b2d0-483d-bff6-815c222de21c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:19.830311 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf5b8f5-b2d0-483d-bff6-815c222de21c None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:19.834796 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50c8c52-b25a-4dd5-9191-d72cac66dc0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:19.836341 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50c8c52-b25a-4dd5-9191-d72cac66dc0f None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:19.837995 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 64/114] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 23 00:42:19 2022] GET /identity/v3/role_assignments?user.id=72a99e5944964a5d98351e82622879c9&scope.project.id=31a760413eac4b69bea4dd231b89ba6e&role.id=130c11043623491c8f8e67ecb6f3efbc => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:19.839066 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5b8f5-b2d0-483d-bff6-815c222de21c None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:19.872416 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:19.959224 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5b8f5-b2d0-483d-bff6-815c222de21c None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:19.959770 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 51/115] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 23 00:42:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 00:42:19.960642 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c8c52-b25a-4dd5-9191-d72cac66dc0f None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:20.001917 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb53c7d-cdb3-427d-8485-cb6c684e73c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:20.002602 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb53c7d-cdb3-427d-8485-cb6c684e73c8 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:20.002887 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb53c7d-cdb3-427d-8485-cb6c684e73c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:20.003165 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb53c7d-cdb3-427d-8485-cb6c684e73c8 None admin] PATH_INFO: `/v3/users/72a99e5944964a5d98351e82622879c9` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:20.004408 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb53c7d-cdb3-427d-8485-cb6c684e73c8 None admin] RBAC: Authorizing `identity:get_user(user_id=72a99e5944964a5d98351e82622879c9)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:20.006568 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb53c7d-cdb3-427d-8485-cb6c684e73c8 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:20.008366 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 65/116] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 23 00:42:19 2022] GET /identity/v3/users/72a99e5944964a5d98351e82622879c9 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:20.008982 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb53c7d-cdb3-427d-8485-cb6c684e73c8 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:20.041989 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:20.077413 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c8c52-b25a-4dd5-9191-d72cac66dc0f None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:20.111446 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:20.112343 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976aeb1a-5ccc-46f9-b13c-a8c62a6e9a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:20.112923 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976aeb1a-5ccc-46f9-b13c-a8c62a6e9a0a None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:20.113220 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976aeb1a-5ccc-46f9-b13c-a8c62a6e9a0a None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:20.113500 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976aeb1a-5ccc-46f9-b13c-a8c62a6e9a0a None admin] PATH_INFO: `/v3/projects/31a760413eac4b69bea4dd231b89ba6e` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:20.114656 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976aeb1a-5ccc-46f9-b13c-a8c62a6e9a0a None admin] RBAC: Authorizing `identity:get_project(project_id=31a760413eac4b69bea4dd231b89ba6e)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:20.116126 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976aeb1a-5ccc-46f9-b13c-a8c62a6e9a0a None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:20.117761 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 52/117] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 23 00:42:19 2022] GET /identity/v3/projects/31a760413eac4b69bea4dd231b89ba6e => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:20.118548 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976aeb1a-5ccc-46f9-b13c-a8c62a6e9a0a None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:20.125836 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb53c7d-cdb3-427d-8485-cb6c684e73c8 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:20.159363 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0731e7d-3309-4253-8548-707c58b5700e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:20.159974 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0731e7d-3309-4253-8548-707c58b5700e None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:20.160814 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0731e7d-3309-4253-8548-707c58b5700e None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:20.161091 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0731e7d-3309-4253-8548-707c58b5700e None admin] PATH_INFO: `/v3/roles` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:20.161757 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0731e7d-3309-4253-8548-707c58b5700e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:20.162064 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0731e7d-3309-4253-8548-707c58b5700e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:20.163486 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0731e7d-3309-4253-8548-707c58b5700e None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:20.171429 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 66/118] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 23 00:42:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:20.172215 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0731e7d-3309-4253-8548-707c58b5700e None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:20.223197 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976aeb1a-5ccc-46f9-b13c-a8c62a6e9a0a None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:20.259577 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3dfc6-1283-42ec-ba5b-ba8056c2a23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:20.260210 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3dfc6-1283-42ec-ba5b-ba8056c2a23a None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:20.260494 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3dfc6-1283-42ec-ba5b-ba8056c2a23a None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:20.260773 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3dfc6-1283-42ec-ba5b-ba8056c2a23a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:20.261987 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3dfc6-1283-42ec-ba5b-ba8056c2a23a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:20.263493 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3dfc6-1283-42ec-ba5b-ba8056c2a23a None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:20.265104 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 53/119] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:42:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:20.266180 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3dfc6-1283-42ec-ba5b-ba8056c2a23a None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:20.270649 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:20.278387 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0731e7d-3309-4253-8548-707c58b5700e None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:20.311263 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b434d-d44e-4928-b886-f9e2a5119540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:20.311976 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b434d-d44e-4928-b886-f9e2a5119540 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:20.312338 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b434d-d44e-4928-b886-f9e2a5119540 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:20.312695 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b434d-d44e-4928-b886-f9e2a5119540 None admin] PATH_INFO: `/v3/projects/ccb48d3ddf7e4b338b0d4782b7b814c5` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:20.313886 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b434d-d44e-4928-b886-f9e2a5119540 None admin] RBAC: Authorizing `identity:get_project(project_id=ccb48d3ddf7e4b338b0d4782b7b814c5)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:20.315389 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b434d-d44e-4928-b886-f9e2a5119540 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:20.317597 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 67/120] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 23 00:42:20 2022] GET /identity/v3/projects/ccb48d3ddf7e4b338b0d4782b7b814c5 => generated 312 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:20.318384 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b434d-d44e-4928-b886-f9e2a5119540 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:20.340210 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:20.369888 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3dfc6-1283-42ec-ba5b-ba8056c2a23a None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:20.403204 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345ea2a-7831-4018-b650-a3a8baf46ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:20.403742 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345ea2a-7831-4018-b650-a3a8baf46ff9 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:20.404025 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345ea2a-7831-4018-b650-a3a8baf46ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:20.404297 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345ea2a-7831-4018-b650-a3a8baf46ff9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:20.417110 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b434d-d44e-4928-b886-f9e2a5119540 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:20.450043 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e5c4c-68a6-4eb7-a1a8-cf2536bd6961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:20.450677 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e5c4c-68a6-4eb7-a1a8-cf2536bd6961 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:20.450961 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e5c4c-68a6-4eb7-a1a8-cf2536bd6961 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:20.451241 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e5c4c-68a6-4eb7-a1a8-cf2536bd6961 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:20.451969 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e5c4c-68a6-4eb7-a1a8-cf2536bd6961 None admin] RBAC: Adding query filter params (role.id=1e2073be75174689aa4fac29e674583d, scope.project.id=31a760413eac4b69bea4dd231b89ba6e, user.id=39aa566fa6c64c41804fb6eefcbf0c20) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:20.452280 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e5c4c-68a6-4eb7-a1a8-cf2536bd6961 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:20.453738 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e5c4c-68a6-4eb7-a1a8-cf2536bd6961 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:20.459933 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 68/121] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 23 00:42:20 2022] GET /identity/v3/role_assignments?user.id=39aa566fa6c64c41804fb6eefcbf0c20&scope.project.id=31a760413eac4b69bea4dd231b89ba6e&role.id=1e2073be75174689aa4fac29e674583d => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:20.460707 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e5c4c-68a6-4eb7-a1a8-cf2536bd6961 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:20.470183 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345ea2a-7831-4018-b650-a3a8baf46ff9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:20.471688 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345ea2a-7831-4018-b650-a3a8baf46ff9 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:20.475153 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:20.576269 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:20.591580 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 54/122] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 23 00:42:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 00:42:20.591580 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345ea2a-7831-4018-b650-a3a8baf46ff9 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:20.604550 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e5c4c-68a6-4eb7-a1a8-cf2536bd6961 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:20.647614 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ff68e-3204-4a16-8ba8-6cd9b4f014da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:20.648256 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ff68e-3204-4a16-8ba8-6cd9b4f014da None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:20.648537 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ff68e-3204-4a16-8ba8-6cd9b4f014da None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:20.648812 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ff68e-3204-4a16-8ba8-6cd9b4f014da None admin] PATH_INFO: `/v3/users/95f9baa9b4b6447384fc32cb1482b8a3` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:20.665479 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364ff68e-3204-4a16-8ba8-6cd9b4f014da None admin] RBAC: Authorizing `identity:get_user(user_id=95f9baa9b4b6447384fc32cb1482b8a3)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:20.667198 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364ff68e-3204-4a16-8ba8-6cd9b4f014da None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:20.669873 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 69/123] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 23 00:42:20 2022] GET /identity/v3/users/95f9baa9b4b6447384fc32cb1482b8a3 => generated 289 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:20.670826 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ff68e-3204-4a16-8ba8-6cd9b4f014da None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:20.702713 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345ea2a-7831-4018-b650-a3a8baf46ff9 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:20.704975 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:20.736097 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b7c39-b735-4868-93d5-121b898e1077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:20.736826 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b7c39-b735-4868-93d5-121b898e1077 None admin] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:20.737113 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b7c39-b735-4868-93d5-121b898e1077 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:20.737382 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b7c39-b735-4868-93d5-121b898e1077 None admin] PATH_INFO: `/v3/projects` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:20.738039 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b7c39-b735-4868-93d5-121b898e1077 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:20.740050 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b7c39-b735-4868-93d5-121b898e1077 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:20.766079 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 55/124] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Oct 23 00:42:20 2022] POST /identity/v3/projects => generated 302 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:42:20.766925 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b7c39-b735-4868-93d5-121b898e1077 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:20.781573 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ff68e-3204-4a16-8ba8-6cd9b4f014da None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:20.823212 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df90446-907f-45f3-896b-c98b3cb40018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:20.823896 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df90446-907f-45f3-896b-c98b3cb40018 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:20.824183 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df90446-907f-45f3-896b-c98b3cb40018 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:20.824456 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df90446-907f-45f3-896b-c98b3cb40018 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:20.825202 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df90446-907f-45f3-896b-c98b3cb40018 None admin] RBAC: Adding query filter params (role.id=130c11043623491c8f8e67ecb6f3efbc, scope.project.id=ccb48d3ddf7e4b338b0d4782b7b814c5, user.id=72a99e5944964a5d98351e82622879c9) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:20.825513 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df90446-907f-45f3-896b-c98b3cb40018 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:20.827064 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df90446-907f-45f3-896b-c98b3cb40018 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:20.833654 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 70/125] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 23 00:42:20 2022] GET /identity/v3/role_assignments?user.id=72a99e5944964a5d98351e82622879c9&scope.project.id=ccb48d3ddf7e4b338b0d4782b7b814c5&role.id=130c11043623491c8f8e67ecb6f3efbc => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:20.834583 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df90446-907f-45f3-896b-c98b3cb40018 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:20.851001 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:20.900209 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b7c39-b735-4868-93d5-121b898e1077 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:20.949226 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7066894e-934e-430f-8711-cb3468fa609e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:20.949829 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066894e-934e-430f-8711-cb3468fa609e None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:20.950138 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066894e-934e-430f-8711-cb3468fa609e None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:20.950426 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066894e-934e-430f-8711-cb3468fa609e None admin] PATH_INFO: `/v3/projects/31a760413eac4b69bea4dd231b89ba6e` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:20.951849 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7066894e-934e-430f-8711-cb3468fa609e None admin] RBAC: Authorizing `identity:get_project(project_id=31a760413eac4b69bea4dd231b89ba6e)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:20.953618 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7066894e-934e-430f-8711-cb3468fa609e None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:20.958168 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 56/126] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 23 00:42:20 2022] GET /identity/v3/projects/31a760413eac4b69bea4dd231b89ba6e => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:20.963356 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7066894e-934e-430f-8711-cb3468fa609e None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:20.982773 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df90446-907f-45f3-896b-c98b3cb40018 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:21.003123 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:21.033515 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e56f35-af7c-483f-8c8a-cee67fc8ebc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:21.034366 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e56f35-af7c-483f-8c8a-cee67fc8ebc6 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:21.034775 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e56f35-af7c-483f-8c8a-cee67fc8ebc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:21.036844 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e56f35-af7c-483f-8c8a-cee67fc8ebc6 None admin] PATH_INFO: `/v3/projects/31a760413eac4b69bea4dd231b89ba6e` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:21.038024 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e56f35-af7c-483f-8c8a-cee67fc8ebc6 None admin] RBAC: Authorizing `identity:get_project(project_id=31a760413eac4b69bea4dd231b89ba6e)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:21.039536 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e56f35-af7c-483f-8c8a-cee67fc8ebc6 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:21.042164 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 71/127] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 23 00:42:20 2022] GET /identity/v3/projects/31a760413eac4b69bea4dd231b89ba6e => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:21.048112 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e56f35-af7c-483f-8c8a-cee67fc8ebc6 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:21.099586 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7066894e-934e-430f-8711-cb3468fa609e None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:21.145357 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0511cc-ed0e-4ef8-b424-c2b3ba33a988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:21.146046 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0511cc-ed0e-4ef8-b424-c2b3ba33a988 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:21.146411 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0511cc-ed0e-4ef8-b424-c2b3ba33a988 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:21.146692 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0511cc-ed0e-4ef8-b424-c2b3ba33a988 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:21.147428 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0511cc-ed0e-4ef8-b424-c2b3ba33a988 None admin] RBAC: Adding query filter params (role.id=9f802c7a3366414c9d0ee9e7a4cb5b74, scope.project.id=31a760413eac4b69bea4dd231b89ba6e, user.id=72a99e5944964a5d98351e82622879c9) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:21.147742 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0511cc-ed0e-4ef8-b424-c2b3ba33a988 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:21.149430 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:21.149623 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0511cc-ed0e-4ef8-b424-c2b3ba33a988 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:21.156694 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 57/128] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 23 00:42:20 2022] GET /identity/v3/role_assignments?user.id=72a99e5944964a5d98351e82622879c9&scope.project.id=31a760413eac4b69bea4dd231b89ba6e&role.id=9f802c7a3366414c9d0ee9e7a4cb5b74 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:21.178579 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e56f35-af7c-483f-8c8a-cee67fc8ebc6 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:21.217590 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d716060-3cbe-49df-8140-6d0d458e1890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:21.218241 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d716060-3cbe-49df-8140-6d0d458e1890 None admin] REQUEST_METHOD: `PUT` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:21.218530 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d716060-3cbe-49df-8140-6d0d458e1890 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:21.218812 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d716060-3cbe-49df-8140-6d0d458e1890 None admin] PATH_INFO: `/v3/projects/31a760413eac4b69bea4dd231b89ba6e/users/95f9baa9b4b6447384fc32cb1482b8a3/roles/7ccf4c0abd6b4bf58ad8cca0e05c25a4` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:21.220870 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d716060-3cbe-49df-8140-6d0d458e1890 None admin] RBAC: Authorizing `identity:create_grant(project_id=31a760413eac4b69bea4dd231b89ba6e, user_id=95f9baa9b4b6447384fc32cb1482b8a3, role_id=7ccf4c0abd6b4bf58ad8cca0e05c25a4)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:21.222776 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d716060-3cbe-49df-8140-6d0d458e1890 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:21.240163 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 72/129] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 23 00:42:21 2022] PUT /identity/v3/projects/31a760413eac4b69bea4dd231b89ba6e/users/95f9baa9b4b6447384fc32cb1482b8a3/roles/7ccf4c0abd6b4bf58ad8cca0e05c25a4 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:42:23.013541 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a2cf5-bf66-4ff8-87e5-0ce8c75045b6 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:23.014056 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a2cf5-bf66-4ff8-87e5-0ce8c75045b6 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:23.014240 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a2cf5-bf66-4ff8-87e5-0ce8c75045b6 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:23.015599 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 58/130] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:42:23.021317 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84298fe-d9fe-4491-a924-b756f6e50940 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:23.021732 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84298fe-d9fe-4491-a924-b756f6e50940 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:23.021953 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84298fe-d9fe-4491-a924-b756f6e50940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:23.040331 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-f84298fe-d9fe-4491-a924-b756f6e50940 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:23.041498 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-f84298fe-d9fe-4491-a924-b756f6e50940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:23.106730 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 73/131] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:42:23.371078 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87226ed5-d6e0-418a-aa76-7401fd6b50d7 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:23.371365 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87226ed5-d6e0-418a-aa76-7401fd6b50d7 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:23.371643 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87226ed5-d6e0-418a-aa76-7401fd6b50d7 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:23.373007 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 59/132] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:42:23.375530 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84298fe-d9fe-4491-a924-b756f6e50940 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:23.377890 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ba757-97d1-45e0-91e0-11f8fe6347b9 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:23.378207 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ba757-97d1-45e0-91e0-11f8fe6347b9 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:23.378497 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ba757-97d1-45e0-91e0-11f8fe6347b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:23.397245 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-876ba757-97d1-45e0-91e0-11f8fe6347b9 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:23.398467 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-876ba757-97d1-45e0-91e0-11f8fe6347b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:23.437653 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:23.463886 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 60/133] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 00:42:23.477783 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84298fe-d9fe-4491-a924-b756f6e50940 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:23.511108 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba5b80-6bff-4726-b7dc-9018c99f848c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:23.511735 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba5b80-6bff-4726-b7dc-9018c99f848c None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:23.512017 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba5b80-6bff-4726-b7dc-9018c99f848c None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:23.512291 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba5b80-6bff-4726-b7dc-9018c99f848c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:23.513388 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ba5b80-6bff-4726-b7dc-9018c99f848c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:23.514881 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ba5b80-6bff-4726-b7dc-9018c99f848c None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:23.516458 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 74/134] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:42:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:23.521901 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ba757-97d1-45e0-91e0-11f8fe6347b9 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:23.540213 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:23.620309 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ba757-97d1-45e0-91e0-11f8fe6347b9 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:23.653123 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85dfe76-968d-490b-bc04-37ee663f0183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:23.653664 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85dfe76-968d-490b-bc04-37ee663f0183 None admin] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:23.653948 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85dfe76-968d-490b-bc04-37ee663f0183 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:23.654258 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85dfe76-968d-490b-bc04-37ee663f0183 None admin] PATH_INFO: `/v3/users` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:23.654917 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85dfe76-968d-490b-bc04-37ee663f0183 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:23.656730 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85dfe76-968d-490b-bc04-37ee663f0183 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:23.677569 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 61/135] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 23 00:42:23 2022] POST /identity/v3/users => generated 283 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:42:23.731537 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba5b80-6bff-4726-b7dc-9018c99f848c None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:23.835778 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba5b80-6bff-4726-b7dc-9018c99f848c None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:23.865842 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:23.871702 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca48164-b9ae-4132-9f9c-2a5a3c0fa222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:23.872369 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca48164-b9ae-4132-9f9c-2a5a3c0fa222 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:23.872650 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca48164-b9ae-4132-9f9c-2a5a3c0fa222 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:23.872923 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca48164-b9ae-4132-9f9c-2a5a3c0fa222 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:23.883732 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca48164-b9ae-4132-9f9c-2a5a3c0fa222 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:42:23.888598 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-cca48164-b9ae-4132-9f9c-2a5a3c0fa222 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 00:42:23.888598 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:42:23.888598 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:42:23.888598 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:42:23.888598 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:42:23.888598 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:42:23.888598 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:42:23.888598 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:42:23.888598 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:42:23.888598 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:42:23.888598 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:42:23.888598 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:42:23.888598 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:42:23.888598 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:42:23.888598 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:42:23.888598 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:42:23.889449 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:42:23.889449 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:42:23.889449 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:42:23.889449 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:42:23.889449 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:42:23.889449 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:42:23.889449 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:42:23.889449 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:42:23.889449 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:42:23.889449 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:42:23.889449 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:42:23.889449 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:42:23.889449 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:42:23.889449 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:42:23.889449 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:42:23.889449 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:42:23.890313 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:42:23.890313 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:42:23.890313 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:42:23.890313 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:42:23.890313 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:42:23.890313 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:42:23.890313 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:42:23.890313 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:42:23.890313 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:42:23.890313 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:42:23.890313 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 00:42:23.890313 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:42:23.890313 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 75/136] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 23 00:42:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:42:23.895584 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85dfe76-968d-490b-bc04-37ee663f0183 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:23.982179 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:24.018968 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85dfe76-968d-490b-bc04-37ee663f0183 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:24.065804 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbae5b7-1354-4acb-a527-25a531d5b526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:24.066496 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbae5b7-1354-4acb-a527-25a531d5b526 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:24.066791 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbae5b7-1354-4acb-a527-25a531d5b526 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:24.067072 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbae5b7-1354-4acb-a527-25a531d5b526 None admin] PATH_INFO: `/v3/roles` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:24.067759 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbae5b7-1354-4acb-a527-25a531d5b526 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:24.068068 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbae5b7-1354-4acb-a527-25a531d5b526 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:24.070434 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbae5b7-1354-4acb-a527-25a531d5b526 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:24.080144 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 62/137] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 23 00:42:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:24.086348 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca48164-b9ae-4132-9f9c-2a5a3c0fa222 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:24.209398 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca48164-b9ae-4132-9f9c-2a5a3c0fa222 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:24.253078 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207dcf01-275a-48df-a698-d994e1f06c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:24.253654 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207dcf01-275a-48df-a698-d994e1f06c0d None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:24.253970 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207dcf01-275a-48df-a698-d994e1f06c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:24.254327 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207dcf01-275a-48df-a698-d994e1f06c0d None admin] PATH_INFO: `/v3/users/95f9baa9b4b6447384fc32cb1482b8a3` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:24.255543 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207dcf01-275a-48df-a698-d994e1f06c0d None admin] RBAC: Authorizing `identity:get_user(user_id=95f9baa9b4b6447384fc32cb1482b8a3)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:24.257014 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207dcf01-275a-48df-a698-d994e1f06c0d None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:24.258938 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 76/138] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 23 00:42:24 2022] GET /identity/v3/users/95f9baa9b4b6447384fc32cb1482b8a3 => generated 289 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:42:24.265315 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbae5b7-1354-4acb-a527-25a531d5b526 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:24.418626 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbae5b7-1354-4acb-a527-25a531d5b526 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:24.459398 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816d695-94fe-4950-91af-5795656e7c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:24.460363 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816d695-94fe-4950-91af-5795656e7c74 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:24.460866 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816d695-94fe-4950-91af-5795656e7c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:24.461359 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816d695-94fe-4950-91af-5795656e7c74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:24.465289 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:24.533366 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816d695-94fe-4950-91af-5795656e7c74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:24.534800 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816d695-94fe-4950-91af-5795656e7c74 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:24.636576 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 63/139] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 23 00:42:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 00:42:24.642223 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207dcf01-275a-48df-a698-d994e1f06c0d None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:24.701877 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:24.750125 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207dcf01-275a-48df-a698-d994e1f06c0d None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:24.786179 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6300d5-e4b9-4b08-8b58-5c8e0382886a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:24.787141 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6300d5-e4b9-4b08-8b58-5c8e0382886a None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:24.787632 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6300d5-e4b9-4b08-8b58-5c8e0382886a None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:24.788095 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6300d5-e4b9-4b08-8b58-5c8e0382886a None admin] PATH_INFO: `/v3/projects/31a760413eac4b69bea4dd231b89ba6e` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:24.789412 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6300d5-e4b9-4b08-8b58-5c8e0382886a None admin] RBAC: Authorizing `identity:get_project(project_id=31a760413eac4b69bea4dd231b89ba6e)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:24.791083 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6300d5-e4b9-4b08-8b58-5c8e0382886a None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:24.792917 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 77/140] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 23 00:42:24 2022] GET /identity/v3/projects/31a760413eac4b69bea4dd231b89ba6e => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:24.798891 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816d695-94fe-4950-91af-5795656e7c74 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:24.835222 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:24.902495 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816d695-94fe-4950-91af-5795656e7c74 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:24.939635 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3cdad7-0c23-4395-91b1-3772db6e26c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:24.940247 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3cdad7-0c23-4395-91b1-3772db6e26c8 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:24.940537 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3cdad7-0c23-4395-91b1-3772db6e26c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:24.940814 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3cdad7-0c23-4395-91b1-3772db6e26c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:24.942066 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3cdad7-0c23-4395-91b1-3772db6e26c8 None admin] RBAC: Adding query filter params (role.id=7ccf4c0abd6b4bf58ad8cca0e05c25a4, scope.project.id=31a760413eac4b69bea4dd231b89ba6e, user.id=95f9baa9b4b6447384fc32cb1482b8a3) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:24.942403 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3cdad7-0c23-4395-91b1-3772db6e26c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:24.943860 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3cdad7-0c23-4395-91b1-3772db6e26c8 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:24.950039 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 64/141] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 23 00:42:24 2022] GET /identity/v3/role_assignments?user.id=95f9baa9b4b6447384fc32cb1482b8a3&scope.project.id=31a760413eac4b69bea4dd231b89ba6e&role.id=7ccf4c0abd6b4bf58ad8cca0e05c25a4 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:26.020724 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8deb6-f849-4e47-91b4-6cac2764e47e None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:26.021248 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8deb6-f849-4e47-91b4-6cac2764e47e None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:26.021319 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8deb6-f849-4e47-91b4-6cac2764e47e None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:26.022824 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 78/142] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:42:26.027926 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29902277-3cff-4c95-8212-9f5f0c463b9b None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:26.028335 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29902277-3cff-4c95-8212-9f5f0c463b9b None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:26.028541 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29902277-3cff-4c95-8212-9f5f0c463b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:26.047511 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-29902277-3cff-4c95-8212-9f5f0c463b9b None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:26.048709 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-29902277-3cff-4c95-8212-9f5f0c463b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:26.120687 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 65/143] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 00:42:26.187110 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b57524-42d1-4612-9b20-bf2be779889f None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:26.187412 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b57524-42d1-4612-9b20-bf2be779889f None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:26.187658 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b57524-42d1-4612-9b20-bf2be779889f None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:26.189166 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 79/144] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:42:26.194606 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb3532-e60f-46fe-ae7b-b255274a2e93 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:26.194893 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb3532-e60f-46fe-ae7b-b255274a2e93 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:26.195166 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb3532-e60f-46fe-ae7b-b255274a2e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:26.215164 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-b2bb3532-e60f-46fe-ae7b-b255274a2e93 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:26.216380 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-b2bb3532-e60f-46fe-ae7b-b255274a2e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:26.249016 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:26.292792 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 66/145] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:42:26.318537 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abdbe37-128d-4e4e-a46d-32cf4544233d None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:26.318823 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abdbe37-128d-4e4e-a46d-32cf4544233d None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:26.319095 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abdbe37-128d-4e4e-a46d-32cf4544233d None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:26.320569 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 80/146] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:42:26.325468 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7cd2c-f949-4ba2-a8ea-ea6a1ada18d1 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:26.325763 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7cd2c-f949-4ba2-a8ea-ea6a1ada18d1 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:26.326046 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7cd2c-f949-4ba2-a8ea-ea6a1ada18d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:26.344460 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-cbe7cd2c-f949-4ba2-a8ea-ea6a1ada18d1 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:26.345659 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-cbe7cd2c-f949-4ba2-a8ea-ea6a1ada18d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:26.395480 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abdbe37-128d-4e4e-a46d-32cf4544233d None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:26.413804 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 67/147] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:42:26.497855 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abdbe37-128d-4e4e-a46d-32cf4544233d None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:26.524011 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:26.533298 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb367ff4-4f3b-4796-9fd9-15bbbba1307a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:26.534239 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb367ff4-4f3b-4796-9fd9-15bbbba1307a None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:26.534718 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb367ff4-4f3b-4796-9fd9-15bbbba1307a None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:26.535187 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb367ff4-4f3b-4796-9fd9-15bbbba1307a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:26.546363 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb367ff4-4f3b-4796-9fd9-15bbbba1307a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:42:26.551855 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-cb367ff4-4f3b-4796-9fd9-15bbbba1307a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:42:26.551855 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:42:26.551855 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:42:26.551855 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:42:26.551855 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:42:26.551855 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:42:26.551855 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:42:26.551855 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:42:26.551855 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:42:26.551855 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:42:26.551855 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:42:26.551855 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:42:26.551855 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:42:26.551855 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:42:26.551855 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:42:26.551855 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:42:26.552852 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:42:26.552852 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:42:26.552852 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:42:26.552852 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:42:26.552852 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:42:26.552852 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:42:26.552852 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:42:26.552852 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:42:26.552852 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:42:26.552852 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:42:26.552852 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:42:26.552852 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:42:26.552852 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:42:26.552852 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:42:26.552852 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:42:26.552852 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:42:26.553936 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:42:26.553936 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:42:26.553936 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:42:26.553936 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:42:26.553936 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:42:26.553936 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:42:26.553936 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:42:26.553936 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:42:26.553936 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:42:26.553936 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:42:26.553936 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:42:26.553936 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:42:26.555566 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 81/148] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 23 00:42:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:42:26.561317 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7cd2c-f949-4ba2-a8ea-ea6a1ada18d1 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:26.563046 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb367ff4-4f3b-4796-9fd9-15bbbba1307a None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:26.661749 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:26.672467 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7cd2c-f949-4ba2-a8ea-ea6a1ada18d1 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:26.676411 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb367ff4-4f3b-4796-9fd9-15bbbba1307a None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:26.706338 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee21a14-543e-4786-acab-047aff629a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:26.706949 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee21a14-543e-4786-acab-047aff629a0d None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:26.707774 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee21a14-543e-4786-acab-047aff629a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:26.708053 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee21a14-543e-4786-acab-047aff629a0d None admin] PATH_INFO: `/v3/roles` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:26.708743 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee21a14-543e-4786-acab-047aff629a0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:26.709047 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee21a14-543e-4786-acab-047aff629a0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:26.710448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee21a14-543e-4786-acab-047aff629a0d None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:26.710600 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd71040-8320-40fa-95a5-e972a50ec6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:26.711235 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd71040-8320-40fa-95a5-e972a50ec6f8 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:26.711525 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd71040-8320-40fa-95a5-e972a50ec6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:26.711848 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd71040-8320-40fa-95a5-e972a50ec6f8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:26.718349 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 68/149] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 23 00:42:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:26.719132 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee21a14-543e-4786-acab-047aff629a0d None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:26.724377 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd71040-8320-40fa-95a5-e972a50ec6f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:42:26.729895 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-0bd71040-8320-40fa-95a5-e972a50ec6f8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 00:42:26.729895 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:42:26.729895 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:42:26.729895 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:42:26.729895 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:42:26.729895 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:42:26.729895 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:42:26.729895 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:42:26.729895 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:42:26.729895 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:42:26.729895 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:42:26.729895 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:42:26.729895 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:42:26.729895 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:42:26.729895 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:42:26.729895 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:42:26.730753 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:42:26.730753 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:42:26.730753 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:42:26.730753 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:42:26.730753 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:42:26.730753 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:42:26.730753 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:42:26.730753 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:42:26.730753 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:42:26.730753 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:42:26.730753 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:42:26.730753 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:42:26.730753 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:42:26.730753 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:42:26.730753 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:42:26.730753 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:42:26.731508 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:42:26.731508 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:42:26.731508 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:42:26.731508 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:42:26.731508 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:42:26.731508 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:42:26.731508 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:42:26.731508 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:42:26.731508 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:42:26.731508 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:42:26.731508 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 00:42:26.731508 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:42:26.731508 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 82/150] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 23 00:42:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:42:26.733168 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd71040-8320-40fa-95a5-e972a50ec6f8 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:26.781469 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:26.817734 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee21a14-543e-4786-acab-047aff629a0d None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:26.833208 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd71040-8320-40fa-95a5-e972a50ec6f8 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:26.849319 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e2d73-e61f-46f4-b24d-1fe2677d2375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:26.849935 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e2d73-e61f-46f4-b24d-1fe2677d2375 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:26.850245 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e2d73-e61f-46f4-b24d-1fe2677d2375 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:26.850516 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e2d73-e61f-46f4-b24d-1fe2677d2375 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:26.851606 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741e2d73-e61f-46f4-b24d-1fe2677d2375 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:26.853058 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741e2d73-e61f-46f4-b24d-1fe2677d2375 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:26.854917 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 69/151] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:42:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:26.855670 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e2d73-e61f-46f4-b24d-1fe2677d2375 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:26.866366 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc72ddf-75b8-4d8e-a6c4-d3458f61c7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:26.866990 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc72ddf-75b8-4d8e-a6c4-d3458f61c7f3 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:26.867269 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc72ddf-75b8-4d8e-a6c4-d3458f61c7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:26.867543 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc72ddf-75b8-4d8e-a6c4-d3458f61c7f3 None admin] PATH_INFO: `/v3/users/801b358ebb3948f386eba8d63f6bea2f` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:26.878092 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:26.881263 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc72ddf-75b8-4d8e-a6c4-d3458f61c7f3 None admin] RBAC: Authorizing `identity:get_user(user_id=801b358ebb3948f386eba8d63f6bea2f)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:26.882752 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc72ddf-75b8-4d8e-a6c4-d3458f61c7f3 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:26.884354 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 83/152] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 23 00:42:26 2022] GET /identity/v3/users/801b358ebb3948f386eba8d63f6bea2f => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:26.885095 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc72ddf-75b8-4d8e-a6c4-d3458f61c7f3 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:26.958396 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e2d73-e61f-46f4-b24d-1fe2677d2375 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:26.982302 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc72ddf-75b8-4d8e-a6c4-d3458f61c7f3 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:26.989859 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:26.991265 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421087d-123c-44c0-a459-91f79c9a520d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:26.991919 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421087d-123c-44c0-a459-91f79c9a520d None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:26.992204 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421087d-123c-44c0-a459-91f79c9a520d None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:26.992571 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421087d-123c-44c0-a459-91f79c9a520d None admin] PATH_INFO: `/v3/roles` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:26.993136 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8421087d-123c-44c0-a459-91f79c9a520d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:26.993447 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8421087d-123c-44c0-a459-91f79c9a520d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:26.994863 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8421087d-123c-44c0-a459-91f79c9a520d None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:27.002660 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 70/153] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 23 00:42:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:27.003446 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421087d-123c-44c0-a459-91f79c9a520d None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:27.022536 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd81b22a-262b-4974-9b33-33e9f327cd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:27.023260 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81b22a-262b-4974-9b33-33e9f327cd01 None admin] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:27.023690 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81b22a-262b-4974-9b33-33e9f327cd01 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:27.023967 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81b22a-262b-4974-9b33-33e9f327cd01 None admin] PATH_INFO: `/v3/users` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:27.024705 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd81b22a-262b-4974-9b33-33e9f327cd01 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:27.026899 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd81b22a-262b-4974-9b33-33e9f327cd01 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:27.048132 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 84/154] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 23 00:42:26 2022] POST /identity/v3/users => generated 297 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:42:27.049162 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd81b22a-262b-4974-9b33-33e9f327cd01 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:27.098304 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:27.121973 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421087d-123c-44c0-a459-91f79c9a520d None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:27.156175 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd81b22a-262b-4974-9b33-33e9f327cd01 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:27.161792 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30782448-30d1-4e05-b82f-473f9d853272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:27.162812 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30782448-30d1-4e05-b82f-473f9d853272 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:27.163305 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30782448-30d1-4e05-b82f-473f9d853272 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:27.163821 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30782448-30d1-4e05-b82f-473f9d853272 None admin] PATH_INFO: `/v3/projects/c072d440807e45aa8ff63548aa916fc2` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:27.165275 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30782448-30d1-4e05-b82f-473f9d853272 None admin] RBAC: Authorizing `identity:get_project(project_id=c072d440807e45aa8ff63548aa916fc2)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:27.167096 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30782448-30d1-4e05-b82f-473f9d853272 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:27.174026 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 71/155] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 23 00:42:27 2022] GET /identity/v3/projects/c072d440807e45aa8ff63548aa916fc2 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:27.175311 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30782448-30d1-4e05-b82f-473f9d853272 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:27.193182 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb77a3d-48b1-4519-b13c-2d7d6331fe97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:27.193839 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb77a3d-48b1-4519-b13c-2d7d6331fe97 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:27.194146 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb77a3d-48b1-4519-b13c-2d7d6331fe97 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:27.194429 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb77a3d-48b1-4519-b13c-2d7d6331fe97 None admin] PATH_INFO: `/v3/users/801b358ebb3948f386eba8d63f6bea2f` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:27.195617 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb77a3d-48b1-4519-b13c-2d7d6331fe97 None admin] RBAC: Authorizing `identity:get_user(user_id=801b358ebb3948f386eba8d63f6bea2f)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:27.197129 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb77a3d-48b1-4519-b13c-2d7d6331fe97 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:27.198823 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 85/156] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 23 00:42:27 2022] GET /identity/v3/users/801b358ebb3948f386eba8d63f6bea2f => generated 283 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:27.204406 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb77a3d-48b1-4519-b13c-2d7d6331fe97 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:27.245003 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:27.299064 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30782448-30d1-4e05-b82f-473f9d853272 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:27.324646 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb77a3d-48b1-4519-b13c-2d7d6331fe97 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:27.345595 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df314cde-eae9-4643-8186-430bc41117cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:27.346311 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df314cde-eae9-4643-8186-430bc41117cb None admin] REQUEST_METHOD: `PUT` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:27.346590 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df314cde-eae9-4643-8186-430bc41117cb None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:27.346896 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df314cde-eae9-4643-8186-430bc41117cb None admin] PATH_INFO: `/v3/projects/c072d440807e45aa8ff63548aa916fc2/users/801b358ebb3948f386eba8d63f6bea2f/roles/1e2073be75174689aa4fac29e674583d` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:27.351140 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df314cde-eae9-4643-8186-430bc41117cb None admin] RBAC: Authorizing `identity:create_grant(project_id=c072d440807e45aa8ff63548aa916fc2, user_id=801b358ebb3948f386eba8d63f6bea2f, role_id=1e2073be75174689aa4fac29e674583d)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:27.351601 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df314cde-eae9-4643-8186-430bc41117cb None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:27.369968 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 72/157] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 23 00:42:27 2022] PUT /identity/v3/projects/c072d440807e45aa8ff63548aa916fc2/users/801b358ebb3948f386eba8d63f6bea2f/roles/1e2073be75174689aa4fac29e674583d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:42:27.372358 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58da05-4186-47e2-980d-261507565fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:27.373004 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58da05-4186-47e2-980d-261507565fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:27.373279 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58da05-4186-47e2-980d-261507565fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:27.373551 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58da05-4186-47e2-980d-261507565fc5 None admin] PATH_INFO: `/v3/projects/c072d440807e45aa8ff63548aa916fc2` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:27.379135 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a58da05-4186-47e2-980d-261507565fc5 None admin] RBAC: Authorizing `identity:get_project(project_id=c072d440807e45aa8ff63548aa916fc2)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:27.381178 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a58da05-4186-47e2-980d-261507565fc5 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:27.383730 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 86/158] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 23 00:42:27 2022] GET /identity/v3/projects/c072d440807e45aa8ff63548aa916fc2 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:27.389435 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df314cde-eae9-4643-8186-430bc41117cb None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:27.404497 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:27.515495 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df314cde-eae9-4643-8186-430bc41117cb None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:27.557565 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ce493-507c-4c5f-8bb8-52365fbbb2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:27.558629 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ce493-507c-4c5f-8bb8-52365fbbb2f4 None admin] REQUEST_METHOD: `PUT` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:27.559123 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ce493-507c-4c5f-8bb8-52365fbbb2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:27.559603 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ce493-507c-4c5f-8bb8-52365fbbb2f4 None admin] PATH_INFO: `/v3/projects/c072d440807e45aa8ff63548aa916fc2/users/801b358ebb3948f386eba8d63f6bea2f/roles/9f802c7a3366414c9d0ee9e7a4cb5b74` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:27.561749 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3ce493-507c-4c5f-8bb8-52365fbbb2f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=c072d440807e45aa8ff63548aa916fc2, user_id=801b358ebb3948f386eba8d63f6bea2f, role_id=9f802c7a3366414c9d0ee9e7a4cb5b74)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:27.563254 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3ce493-507c-4c5f-8bb8-52365fbbb2f4 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:27.579902 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 73/159] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 23 00:42:27 2022] PUT /identity/v3/projects/c072d440807e45aa8ff63548aa916fc2/users/801b358ebb3948f386eba8d63f6bea2f/roles/9f802c7a3366414c9d0ee9e7a4cb5b74 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:42:29.318271 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab63003-6005-43ce-bdb0-8df982a768df None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:29.319252 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab63003-6005-43ce-bdb0-8df982a768df None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:29.319742 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab63003-6005-43ce-bdb0-8df982a768df None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:29.321316 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 87/160] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:42:29.326732 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32467e-efce-441a-a8ae-665757952b78 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:29.327574 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32467e-efce-441a-a8ae-665757952b78 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:29.328063 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32467e-efce-441a-a8ae-665757952b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:29.347980 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-dc32467e-efce-441a-a8ae-665757952b78 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:29.349728 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-dc32467e-efce-441a-a8ae-665757952b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:29.424196 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:29.429139 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 74/161] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:42:29.471666 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39182f3a-36d2-4d98-b808-ca9bce349e53 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:29.472308 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39182f3a-36d2-4d98-b808-ca9bce349e53 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:29.472799 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39182f3a-36d2-4d98-b808-ca9bce349e53 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:29.474930 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 88/162] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:42:29.480678 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb6d34-9e6f-4f9b-bc11-4d56d62b4f94 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:29.481202 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb6d34-9e6f-4f9b-bc11-4d56d62b4f94 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:29.481782 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb6d34-9e6f-4f9b-bc11-4d56d62b4f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:29.500925 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-22eb6d34-9e6f-4f9b-bc11-4d56d62b4f94 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:29.502516 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-22eb6d34-9e6f-4f9b-bc11-4d56d62b4f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:29.581328 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 75/163] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:42:29.631471 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504cdd9-d364-4b05-af2e-18a6b50bf9cb None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:29.632139 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504cdd9-d364-4b05-af2e-18a6b50bf9cb None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:29.632627 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504cdd9-d364-4b05-af2e-18a6b50bf9cb None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:29.634581 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 89/164] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:42:29.647615 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2c787-184d-49f3-8cdf-9dac4f794785 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:29.648177 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2c787-184d-49f3-8cdf-9dac4f794785 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:29.648611 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2c787-184d-49f3-8cdf-9dac4f794785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:29.669712 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-ccf2c787-184d-49f3-8cdf-9dac4f794785 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:29.671220 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-ccf2c787-184d-49f3-8cdf-9dac4f794785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:29.723728 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d504cdd9-d364-4b05-af2e-18a6b50bf9cb None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:29.742928 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 76/165] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:42:29.762648 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d65b2-dbf1-4e1b-baf0-71de7a89e939 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:29.763168 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d65b2-dbf1-4e1b-baf0-71de7a89e939 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:29.763591 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d65b2-dbf1-4e1b-baf0-71de7a89e939 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:29.765858 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 77/166] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:42:29.770716 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af204ea-4ab7-4617-9551-a82e5f88a6fa None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:29.771151 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af204ea-4ab7-4617-9551-a82e5f88a6fa None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:29.771593 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af204ea-4ab7-4617-9551-a82e5f88a6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:29.791242 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-8af204ea-4ab7-4617-9551-a82e5f88a6fa None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:29.792735 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-8af204ea-4ab7-4617-9551-a82e5f88a6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:29.839368 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:29.844276 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d504cdd9-d364-4b05-af2e-18a6b50bf9cb None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:29.862452 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:29.875433 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 78/167] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:42:29.876368 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af204ea-4ab7-4617-9551-a82e5f88a6fa None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:29.896208 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7877c1d9-5e18-44cc-82d5-6e0d3b784858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:29.897061 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877c1d9-5e18-44cc-82d5-6e0d3b784858 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:29.897594 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877c1d9-5e18-44cc-82d5-6e0d3b784858 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:29.898021 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877c1d9-5e18-44cc-82d5-6e0d3b784858 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:29.911115 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7877c1d9-5e18-44cc-82d5-6e0d3b784858 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:42:29.917230 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-7877c1d9-5e18-44cc-82d5-6e0d3b784858 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:42:29.917230 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:42:29.917230 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:42:29.917230 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:42:29.917230 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:42:29.917230 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:42:29.917230 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:42:29.917230 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:42:29.917230 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:42:29.917230 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:42:29.917230 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:42:29.917230 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:42:29.917230 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:42:29.917230 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:42:29.917230 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:42:29.917230 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:42:29.919010 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:42:29.919010 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:42:29.919010 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:42:29.919010 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:42:29.919010 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:42:29.919010 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:42:29.919010 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:42:29.919010 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:42:29.919010 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:42:29.919010 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:42:29.919010 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:42:29.919010 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:42:29.919010 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:42:29.919010 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:42:29.919010 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:42:29.919010 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:42:29.919829 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:42:29.919829 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:42:29.919829 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:42:29.919829 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:42:29.919829 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:42:29.919829 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:42:29.919829 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:42:29.919829 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:42:29.919829 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:42:29.919829 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:42:29.919829 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:42:29.919829 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:42:29.921979 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 90/168] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 23 00:42:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:42:29.929203 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7877c1d9-5e18-44cc-82d5-6e0d3b784858 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:30.005195 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af204ea-4ab7-4617-9551-a82e5f88a6fa None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:30.042826 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb79edb-43d2-4f4f-84c9-c0581299dbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:30.043460 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb79edb-43d2-4f4f-84c9-c0581299dbe1 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:30.043741 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb79edb-43d2-4f4f-84c9-c0581299dbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:30.044012 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb79edb-43d2-4f4f-84c9-c0581299dbe1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:30.044999 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7877c1d9-5e18-44cc-82d5-6e0d3b784858 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:30.045108 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb79edb-43d2-4f4f-84c9-c0581299dbe1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:30.046574 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb79edb-43d2-4f4f-84c9-c0581299dbe1 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:30.050177 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 79/169] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:42:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:30.050177 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb79edb-43d2-4f4f-84c9-c0581299dbe1 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:30.082253 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fec7bf-4605-4682-9295-72473b8553e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:30.082864 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fec7bf-4605-4682-9295-72473b8553e6 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:30.083145 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fec7bf-4605-4682-9295-72473b8553e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:30.083565 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fec7bf-4605-4682-9295-72473b8553e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:30.084954 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fec7bf-4605-4682-9295-72473b8553e6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:30.085268 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fec7bf-4605-4682-9295-72473b8553e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:30.086710 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fec7bf-4605-4682-9295-72473b8553e6 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:30.095859 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 91/170] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 23 00:42:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:30.096465 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fec7bf-4605-4682-9295-72473b8553e6 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:30.113553 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:30.120570 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:30.157371 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb79edb-43d2-4f4f-84c9-c0581299dbe1 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:30.191284 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b60086-f837-48fa-8e83-b3e811e769c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:30.191928 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b60086-f837-48fa-8e83-b3e811e769c3 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:30.192207 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b60086-f837-48fa-8e83-b3e811e769c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:30.192478 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b60086-f837-48fa-8e83-b3e811e769c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:30.200015 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fec7bf-4605-4682-9295-72473b8553e6 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:30.202296 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b60086-f837-48fa-8e83-b3e811e769c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:42:30.207116 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-56b60086-f837-48fa-8e83-b3e811e769c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:42:30.207116 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:42:30.207116 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:42:30.207116 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:42:30.207116 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:42:30.207116 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:42:30.207116 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:42:30.207116 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:42:30.207116 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:42:30.207116 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:42:30.207116 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:42:30.207116 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:42:30.207116 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:42:30.207116 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:42:30.207116 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:42:30.207116 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:42:30.208002 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:42:30.208002 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:42:30.208002 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:42:30.208002 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:42:30.208002 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:42:30.208002 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:42:30.208002 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:42:30.208002 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:42:30.208002 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:42:30.208002 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:42:30.208002 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:42:30.208002 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:42:30.208002 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:42:30.208002 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:42:30.208002 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:42:30.208002 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:42:30.209554 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:42:30.209554 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:42:30.209554 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:42:30.209554 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:42:30.209554 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:42:30.209554 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:42:30.209554 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:42:30.209554 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:42:30.209554 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:42:30.209554 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:42:30.209554 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:42:30.209554 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:42:30.209554 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 80/171] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 23 00:42:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:42:30.209554 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b60086-f837-48fa-8e83-b3e811e769c3 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:30.236026 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d976a-6f5c-410b-891f-4200a2b1bb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:30.236742 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d976a-6f5c-410b-891f-4200a2b1bb13 None admin] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:30.237024 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d976a-6f5c-410b-891f-4200a2b1bb13 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:30.237293 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d976a-6f5c-410b-891f-4200a2b1bb13 None admin] PATH_INFO: `/v3/users` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:30.237943 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42d976a-6f5c-410b-891f-4200a2b1bb13 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:30.239975 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42d976a-6f5c-410b-891f-4200a2b1bb13 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:30.262163 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 92/172] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 23 00:42:30 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:42:30.262938 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d976a-6f5c-410b-891f-4200a2b1bb13 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:30.323227 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b60086-f837-48fa-8e83-b3e811e769c3 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:30.343595 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:30.354834 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:30.368763 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934a004-0350-49e8-af65-35d86859bf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:30.369538 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934a004-0350-49e8-af65-35d86859bf84 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:30.369819 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934a004-0350-49e8-af65-35d86859bf84 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:30.370114 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934a004-0350-49e8-af65-35d86859bf84 None admin] PATH_INFO: `/v3/users/7acb259e553f460c93acf53b9f75c9b9` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:30.382670 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d976a-6f5c-410b-891f-4200a2b1bb13 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:30.385592 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0934a004-0350-49e8-af65-35d86859bf84 None admin] RBAC: Authorizing `identity:get_user(user_id=7acb259e553f460c93acf53b9f75c9b9)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:30.387143 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0934a004-0350-49e8-af65-35d86859bf84 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:30.393951 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 81/173] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 23 00:42:30 2022] GET /identity/v3/users/7acb259e553f460c93acf53b9f75c9b9 => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:30.393951 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934a004-0350-49e8-af65-35d86859bf84 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:30.427623 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b2627-1e41-4bf1-97d8-319606fb516d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:30.428010 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b2627-1e41-4bf1-97d8-319606fb516d None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:30.428291 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b2627-1e41-4bf1-97d8-319606fb516d None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:30.428620 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b2627-1e41-4bf1-97d8-319606fb516d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:30.441315 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b2627-1e41-4bf1-97d8-319606fb516d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:42:30.448876 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-359b2627-1e41-4bf1-97d8-319606fb516d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 00:42:30.448876 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:42:30.448876 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:42:30.448876 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:42:30.448876 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:42:30.448876 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:42:30.448876 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:42:30.448876 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:42:30.448876 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:42:30.448876 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:42:30.448876 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:42:30.448876 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:42:30.448876 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:42:30.448876 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:42:30.448876 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:42:30.448876 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:42:30.449772 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:42:30.449772 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:42:30.449772 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:42:30.449772 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:42:30.449772 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:42:30.449772 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:42:30.449772 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:42:30.449772 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:42:30.449772 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:42:30.449772 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:42:30.449772 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:42:30.449772 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:42:30.449772 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:42:30.449772 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:42:30.449772 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:42:30.449772 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:42:30.450588 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:42:30.450588 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:42:30.450588 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:42:30.450588 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:42:30.450588 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:42:30.450588 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:42:30.450588 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:42:30.450588 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:42:30.450588 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:42:30.450588 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:42:30.450588 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 00:42:30.450588 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:42:30.450588 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 93/174] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 23 00:42:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:42:30.451302 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b2627-1e41-4bf1-97d8-319606fb516d None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:30.517685 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934a004-0350-49e8-af65-35d86859bf84 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:30.562478 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130cbb1c-26a2-427b-b570-dee93c9fd6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:30.562756 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b2627-1e41-4bf1-97d8-319606fb516d None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:30.563510 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130cbb1c-26a2-427b-b570-dee93c9fd6f6 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:30.564080 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130cbb1c-26a2-427b-b570-dee93c9fd6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:30.564528 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130cbb1c-26a2-427b-b570-dee93c9fd6f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:30.565204 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130cbb1c-26a2-427b-b570-dee93c9fd6f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:30.565507 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130cbb1c-26a2-427b-b570-dee93c9fd6f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:30.567537 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130cbb1c-26a2-427b-b570-dee93c9fd6f6 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:30.580301 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 82/175] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 23 00:42:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:30.584599 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130cbb1c-26a2-427b-b570-dee93c9fd6f6 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:30.604686 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45464387-6013-495e-b9d4-219864a64673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:30.605321 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45464387-6013-495e-b9d4-219864a64673 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:30.605604 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45464387-6013-495e-b9d4-219864a64673 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:30.606163 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45464387-6013-495e-b9d4-219864a64673 None admin] PATH_INFO: `/v3/projects/c072d440807e45aa8ff63548aa916fc2` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:30.607959 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45464387-6013-495e-b9d4-219864a64673 None admin] RBAC: Authorizing `identity:get_project(project_id=c072d440807e45aa8ff63548aa916fc2)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:30.608519 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45464387-6013-495e-b9d4-219864a64673 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:30.614464 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 94/176] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 23 00:42:30 2022] GET /identity/v3/projects/c072d440807e45aa8ff63548aa916fc2 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:30.616126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45464387-6013-495e-b9d4-219864a64673 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:30.620203 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:30.633703 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:30.702545 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130cbb1c-26a2-427b-b570-dee93c9fd6f6 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:30.741852 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45464387-6013-495e-b9d4-219864a64673 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:30.742484 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9abcda7-d605-43dd-a35b-b7d1d1e21c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:30.743287 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abcda7-d605-43dd-a35b-b7d1d1e21c50 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:30.743715 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abcda7-d605-43dd-a35b-b7d1d1e21c50 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:30.744142 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abcda7-d605-43dd-a35b-b7d1d1e21c50 None admin] PATH_INFO: `/v3/roles` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:30.744965 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9abcda7-d605-43dd-a35b-b7d1d1e21c50 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:30.745423 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9abcda7-d605-43dd-a35b-b7d1d1e21c50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:30.747030 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9abcda7-d605-43dd-a35b-b7d1d1e21c50 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:30.757453 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 83/177] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 23 00:42:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:30.758697 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9abcda7-d605-43dd-a35b-b7d1d1e21c50 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:30.796530 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6db0a3-5643-4201-805a-d35b3bf3c5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:30.797356 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6db0a3-5643-4201-805a-d35b3bf3c5f3 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:30.797642 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6db0a3-5643-4201-805a-d35b3bf3c5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:30.797918 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6db0a3-5643-4201-805a-d35b3bf3c5f3 None admin] PATH_INFO: `/v3/users/801b358ebb3948f386eba8d63f6bea2f` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:30.799099 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6db0a3-5643-4201-805a-d35b3bf3c5f3 None admin] RBAC: Authorizing `identity:get_user(user_id=801b358ebb3948f386eba8d63f6bea2f)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:30.800747 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6db0a3-5643-4201-805a-d35b3bf3c5f3 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:30.808424 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 95/178] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 23 00:42:30 2022] GET /identity/v3/users/801b358ebb3948f386eba8d63f6bea2f => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:30.808424 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6db0a3-5643-4201-805a-d35b3bf3c5f3 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:30.874278 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:30.878316 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9abcda7-d605-43dd-a35b-b7d1d1e21c50 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:30.897651 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:30.918154 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796786a-188d-4523-8498-a07bc1b4c9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:30.919111 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796786a-188d-4523-8498-a07bc1b4c9ae None admin] REQUEST_METHOD: `PUT` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:30.919708 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796786a-188d-4523-8498-a07bc1b4c9ae None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:30.920134 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796786a-188d-4523-8498-a07bc1b4c9ae None admin] PATH_INFO: `/v3/projects/c072d440807e45aa8ff63548aa916fc2/users/7acb259e553f460c93acf53b9f75c9b9/roles/130c11043623491c8f8e67ecb6f3efbc` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:30.922385 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d796786a-188d-4523-8498-a07bc1b4c9ae None admin] RBAC: Authorizing `identity:create_grant(project_id=c072d440807e45aa8ff63548aa916fc2, user_id=7acb259e553f460c93acf53b9f75c9b9, role_id=130c11043623491c8f8e67ecb6f3efbc)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:30.924315 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d796786a-188d-4523-8498-a07bc1b4c9ae None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:30.934794 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6db0a3-5643-4201-805a-d35b3bf3c5f3 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:30.945432 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 84/179] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 23 00:42:30 2022] PUT /identity/v3/projects/c072d440807e45aa8ff63548aa916fc2/users/7acb259e553f460c93acf53b9f75c9b9/roles/130c11043623491c8f8e67ecb6f3efbc => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:42:30.946976 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796786a-188d-4523-8498-a07bc1b4c9ae None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:30.972321 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0d05a-2df4-4087-85c8-eb9f9d24fb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:30.973669 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0d05a-2df4-4087-85c8-eb9f9d24fb22 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:30.973838 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0d05a-2df4-4087-85c8-eb9f9d24fb22 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:30.974129 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0d05a-2df4-4087-85c8-eb9f9d24fb22 None admin] PATH_INFO: `/v3/users/801b358ebb3948f386eba8d63f6bea2f` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:30.975419 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf0d05a-2df4-4087-85c8-eb9f9d24fb22 None admin] RBAC: Authorizing `identity:get_user(user_id=801b358ebb3948f386eba8d63f6bea2f)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:30.976939 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf0d05a-2df4-4087-85c8-eb9f9d24fb22 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:30.979088 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 96/180] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 23 00:42:30 2022] GET /identity/v3/users/801b358ebb3948f386eba8d63f6bea2f => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:30.985196 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0d05a-2df4-4087-85c8-eb9f9d24fb22 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:31.088733 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796786a-188d-4523-8498-a07bc1b4c9ae None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:31.131878 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4663612-33fd-4d89-80d1-194e268da5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:31.132771 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4663612-33fd-4d89-80d1-194e268da5b6 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:31.133201 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4663612-33fd-4d89-80d1-194e268da5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:31.133678 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4663612-33fd-4d89-80d1-194e268da5b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:31.168059 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:31.218002 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4663612-33fd-4d89-80d1-194e268da5b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:31.219459 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4663612-33fd-4d89-80d1-194e268da5b6 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:31.247718 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0d05a-2df4-4087-85c8-eb9f9d24fb22 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:31.296951 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436d730-20d4-43a5-825f-9aa2dda8ad16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:31.298034 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436d730-20d4-43a5-825f-9aa2dda8ad16 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:31.298478 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436d730-20d4-43a5-825f-9aa2dda8ad16 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:31.298898 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436d730-20d4-43a5-825f-9aa2dda8ad16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:31.310789 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:31.337871 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 85/181] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 23 00:42:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 00:42:31.347129 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4663612-33fd-4d89-80d1-194e268da5b6 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:31.404661 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b436d730-20d4-43a5-825f-9aa2dda8ad16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:31.406732 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b436d730-20d4-43a5-825f-9aa2dda8ad16 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:31.450446 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:31.522457 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4663612-33fd-4d89-80d1-194e268da5b6 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:31.581734 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 97/182] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 23 00:42:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 00:42:31.588444 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436d730-20d4-43a5-825f-9aa2dda8ad16 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:31.592583 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306073d-36dd-4863-a221-b790dda2e2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:31.593073 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306073d-36dd-4863-a221-b790dda2e2cc None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:31.593348 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306073d-36dd-4863-a221-b790dda2e2cc None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:31.593624 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306073d-36dd-4863-a221-b790dda2e2cc None admin] PATH_INFO: `/v3/projects/c072d440807e45aa8ff63548aa916fc2` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:31.594869 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1306073d-36dd-4863-a221-b790dda2e2cc None admin] RBAC: Authorizing `identity:get_project(project_id=c072d440807e45aa8ff63548aa916fc2)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:31.596337 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1306073d-36dd-4863-a221-b790dda2e2cc None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:31.603060 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 86/183] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 23 00:42:31 2022] GET /identity/v3/projects/c072d440807e45aa8ff63548aa916fc2 => generated 302 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:31.604776 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306073d-36dd-4863-a221-b790dda2e2cc None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:31.659253 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:31.763602 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436d730-20d4-43a5-825f-9aa2dda8ad16 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:31.784630 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306073d-36dd-4863-a221-b790dda2e2cc None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:31.834034 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664f2e9-821d-478c-b845-c38cd966fc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:31.834691 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664f2e9-821d-478c-b845-c38cd966fc94 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:31.834970 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664f2e9-821d-478c-b845-c38cd966fc94 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:31.835238 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664f2e9-821d-478c-b845-c38cd966fc94 None admin] PATH_INFO: `/v3/projects/c072d440807e45aa8ff63548aa916fc2` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:31.837186 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6664f2e9-821d-478c-b845-c38cd966fc94 None admin] RBAC: Authorizing `identity:get_project(project_id=c072d440807e45aa8ff63548aa916fc2)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:31.838681 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6664f2e9-821d-478c-b845-c38cd966fc94 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:31.840338 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 98/184] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 23 00:42:31 2022] GET /identity/v3/projects/c072d440807e45aa8ff63548aa916fc2 => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:31.840706 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:31.852665 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664f2e9-821d-478c-b845-c38cd966fc94 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:31.859210 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ec8e2-f784-4723-9624-22b184336263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:31.859767 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ec8e2-f784-4723-9624-22b184336263 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:31.860047 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ec8e2-f784-4723-9624-22b184336263 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:31.860317 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ec8e2-f784-4723-9624-22b184336263 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:31.861049 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ec8e2-f784-4723-9624-22b184336263 None admin] RBAC: Adding query filter params (role.id=1e2073be75174689aa4fac29e674583d, scope.project.id=c072d440807e45aa8ff63548aa916fc2, user.id=801b358ebb3948f386eba8d63f6bea2f) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:31.861351 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ec8e2-f784-4723-9624-22b184336263 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:31.862831 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ec8e2-f784-4723-9624-22b184336263 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:31.880280 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 87/185] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 23 00:42:31 2022] GET /identity/v3/role_assignments?user.id=801b358ebb3948f386eba8d63f6bea2f&scope.project.id=c072d440807e45aa8ff63548aa916fc2&role.id=1e2073be75174689aa4fac29e674583d => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:31.987470 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664f2e9-821d-478c-b845-c38cd966fc94 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:32.000007 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:32.042512 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a40683-1aec-4a9d-8bf8-b7a518c3e9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:32.043148 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a40683-1aec-4a9d-8bf8-b7a518c3e9e5 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:32.043436 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a40683-1aec-4a9d-8bf8-b7a518c3e9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:32.043714 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a40683-1aec-4a9d-8bf8-b7a518c3e9e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:32.044470 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a40683-1aec-4a9d-8bf8-b7a518c3e9e5 None admin] RBAC: Adding query filter params (role.id=9f802c7a3366414c9d0ee9e7a4cb5b74, scope.project.id=c072d440807e45aa8ff63548aa916fc2, user.id=801b358ebb3948f386eba8d63f6bea2f) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:32.044790 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a40683-1aec-4a9d-8bf8-b7a518c3e9e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:32.046313 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a40683-1aec-4a9d-8bf8-b7a518c3e9e5 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:32.053762 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 99/186] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 23 00:42:31 2022] GET /identity/v3/role_assignments?user.id=801b358ebb3948f386eba8d63f6bea2f&scope.project.id=c072d440807e45aa8ff63548aa916fc2&role.id=9f802c7a3366414c9d0ee9e7a4cb5b74 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:32.638103 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17358d46-35ee-4791-9c2d-24e1539a74ab None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:32.638629 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17358d46-35ee-4791-9c2d-24e1539a74ab None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:32.638629 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17358d46-35ee-4791-9c2d-24e1539a74ab None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:32.640158 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 88/187] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:42:32.645595 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2d6f7-ccfb-49b6-bfab-977bf323a939 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:32.645990 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2d6f7-ccfb-49b6-bfab-977bf323a939 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:32.646177 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2d6f7-ccfb-49b6-bfab-977bf323a939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:32.664426 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-4fd2d6f7-ccfb-49b6-bfab-977bf323a939 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:32.665584 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-4fd2d6f7-ccfb-49b6-bfab-977bf323a939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:32.729888 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 100/188] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:42:32.896921 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4d62c-e125-4b09-bea9-e4bda9e441a0 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:32.897244 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4d62c-e125-4b09-bea9-e4bda9e441a0 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:32.897432 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4d62c-e125-4b09-bea9-e4bda9e441a0 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:32.898932 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 89/189] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:42:32.903873 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cb31d-d849-4fdd-89d9-0f0894a16c3b None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:32.904166 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cb31d-d849-4fdd-89d9-0f0894a16c3b None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:32.904442 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cb31d-d849-4fdd-89d9-0f0894a16c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:32.922697 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-236cb31d-d849-4fdd-89d9-0f0894a16c3b None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:32.923868 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-236cb31d-d849-4fdd-89d9-0f0894a16c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:32.991059 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 101/190] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:42:32.998675 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4d62c-e125-4b09-bea9-e4bda9e441a0 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:33.107542 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4d62c-e125-4b09-bea9-e4bda9e441a0 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:33.140717 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea0c16-d3f6-4e4d-9ffe-5240824d67de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:33.141338 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea0c16-d3f6-4e4d-9ffe-5240824d67de None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:33.141615 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea0c16-d3f6-4e4d-9ffe-5240824d67de None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:33.141886 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea0c16-d3f6-4e4d-9ffe-5240824d67de None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:33.152512 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feea0c16-d3f6-4e4d-9ffe-5240824d67de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:42:33.157728 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-feea0c16-d3f6-4e4d-9ffe-5240824d67de None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 00:42:33.157728 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:42:33.157728 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:42:33.157728 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:42:33.157728 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:42:33.157728 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:42:33.157728 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:42:33.157728 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:42:33.157728 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:42:33.157728 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:42:33.157728 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:42:33.157728 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:42:33.157728 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:42:33.157728 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:42:33.157728 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:42:33.157728 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:42:33.158710 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:42:33.158710 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:42:33.158710 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:42:33.158710 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:42:33.158710 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:42:33.158710 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:42:33.158710 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:42:33.158710 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:42:33.158710 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:42:33.158710 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:42:33.158710 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:42:33.158710 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:42:33.158710 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:42:33.158710 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:42:33.158710 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:42:33.158710 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:42:33.159495 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:42:33.159495 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:42:33.159495 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:42:33.159495 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:42:33.159495 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:42:33.159495 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:42:33.159495 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:42:33.159495 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:42:33.159495 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:42:33.159495 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:42:33.159495 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 00:42:33.159495 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:42:33.159495 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 90/191] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 23 00:42:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:42:33.166825 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236cb31d-d849-4fdd-89d9-0f0894a16c3b None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:33.199249 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:33.274694 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea0c16-d3f6-4e4d-9ffe-5240824d67de None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:33.276952 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236cb31d-d849-4fdd-89d9-0f0894a16c3b None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:33.311964 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aaaff7-de53-43f4-a0f6-fcbaa39fb063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:33.312579 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aaaff7-de53-43f4-a0f6-fcbaa39fb063 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:33.312861 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aaaff7-de53-43f4-a0f6-fcbaa39fb063 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:33.313137 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aaaff7-de53-43f4-a0f6-fcbaa39fb063 None admin] PATH_INFO: `/v3/roles` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:33.313803 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aaaff7-de53-43f4-a0f6-fcbaa39fb063 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:33.314133 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aaaff7-de53-43f4-a0f6-fcbaa39fb063 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:33.315531 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aaaff7-de53-43f4-a0f6-fcbaa39fb063 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:33.324549 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 102/192] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 23 00:42:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:33.328747 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:33.330028 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aaaff7-de53-43f4-a0f6-fcbaa39fb063 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:33.385319 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea0c16-d3f6-4e4d-9ffe-5240824d67de None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:33.419633 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd41b7f-799b-4153-b13c-a57607a2643f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:33.420163 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd41b7f-799b-4153-b13c-a57607a2643f None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:33.420449 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd41b7f-799b-4153-b13c-a57607a2643f None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:33.420722 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd41b7f-799b-4153-b13c-a57607a2643f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:33.421812 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd41b7f-799b-4153-b13c-a57607a2643f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:33.423295 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd41b7f-799b-4153-b13c-a57607a2643f None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:33.425019 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 91/193] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:42:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:42:33.430471 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:33.430961 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd41b7f-799b-4153-b13c-a57607a2643f None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:33.438757 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aaaff7-de53-43f4-a0f6-fcbaa39fb063 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:33.474779 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3aae19-e1bd-44a0-a504-d65797555905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:33.475473 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3aae19-e1bd-44a0-a504-d65797555905 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:33.475758 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3aae19-e1bd-44a0-a504-d65797555905 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:33.476030 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3aae19-e1bd-44a0-a504-d65797555905 None admin] PATH_INFO: `/v3/users/c76c7bff31e94de3bf9c5ef7250989a8` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:33.490229 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3aae19-e1bd-44a0-a504-d65797555905 None admin] RBAC: Authorizing `identity:get_user(user_id=c76c7bff31e94de3bf9c5ef7250989a8)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:33.491695 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3aae19-e1bd-44a0-a504-d65797555905 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:33.493325 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 103/194] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 23 00:42:33 2022] GET /identity/v3/users/c76c7bff31e94de3bf9c5ef7250989a8 => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:42:33.494481 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec621a65-6aa5-4a9d-8f2f-c7de2b2de3e4 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:33.494762 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec621a65-6aa5-4a9d-8f2f-c7de2b2de3e4 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:33.495035 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec621a65-6aa5-4a9d-8f2f-c7de2b2de3e4 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:33.496246 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 104/195] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:42:33.496246 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec621a65-6aa5-4a9d-8f2f-c7de2b2de3e4 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:33.536359 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd41b7f-799b-4153-b13c-a57607a2643f None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:33.557081 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:33.571400 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197eeef5-ed6e-43ce-b4bc-0e4024576c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:33.572007 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197eeef5-ed6e-43ce-b4bc-0e4024576c3b None admin] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:33.572287 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197eeef5-ed6e-43ce-b4bc-0e4024576c3b None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:33.572563 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197eeef5-ed6e-43ce-b4bc-0e4024576c3b None admin] PATH_INFO: `/v3/users` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:33.573242 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197eeef5-ed6e-43ce-b4bc-0e4024576c3b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:33.574735 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197eeef5-ed6e-43ce-b4bc-0e4024576c3b None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:33.598109 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 92/196] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 23 00:42:33 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:42:33.603619 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931cc09-35f6-40cf-858f-3f0ca3691548 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:33.604026 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931cc09-35f6-40cf-858f-3f0ca3691548 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:33.604563 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931cc09-35f6-40cf-858f-3f0ca3691548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:33.604660 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec621a65-6aa5-4a9d-8f2f-c7de2b2de3e4 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:33.626424 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-9931cc09-35f6-40cf-858f-3f0ca3691548 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:33.627653 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-9931cc09-35f6-40cf-858f-3f0ca3691548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:33.648559 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe908c2-8c73-4c05-bc71-dd002851199f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:33.649649 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe908c2-8c73-4c05-bc71-dd002851199f None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:33.649649 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe908c2-8c73-4c05-bc71-dd002851199f None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:33.649842 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe908c2-8c73-4c05-bc71-dd002851199f None admin] PATH_INFO: `/v3/projects/c072d440807e45aa8ff63548aa916fc2` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:33.651100 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe908c2-8c73-4c05-bc71-dd002851199f None admin] RBAC: Authorizing `identity:get_project(project_id=c072d440807e45aa8ff63548aa916fc2)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:33.652616 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe908c2-8c73-4c05-bc71-dd002851199f None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:33.654433 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 105/197] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 23 00:42:33 2022] GET /identity/v3/projects/c072d440807e45aa8ff63548aa916fc2 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:42:33.660592 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe908c2-8c73-4c05-bc71-dd002851199f None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:33.684711 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:33.710702 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 93/198] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:42:33.776014 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe908c2-8c73-4c05-bc71-dd002851199f None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:33.813981 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601c3f5-08c5-417a-a581-38696c4fe91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:33.814689 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601c3f5-08c5-417a-a581-38696c4fe91d None admin] REQUEST_METHOD: `PUT` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:33.814976 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601c3f5-08c5-417a-a581-38696c4fe91d None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:33.815252 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601c3f5-08c5-417a-a581-38696c4fe91d None admin] PATH_INFO: `/v3/projects/c072d440807e45aa8ff63548aa916fc2/users/c76c7bff31e94de3bf9c5ef7250989a8/roles/7ccf4c0abd6b4bf58ad8cca0e05c25a4` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:33.817970 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1601c3f5-08c5-417a-a581-38696c4fe91d None admin] RBAC: Authorizing `identity:create_grant(project_id=c072d440807e45aa8ff63548aa916fc2, user_id=c76c7bff31e94de3bf9c5ef7250989a8, role_id=7ccf4c0abd6b4bf58ad8cca0e05c25a4)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:33.819518 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1601c3f5-08c5-417a-a581-38696c4fe91d None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:33.832395 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 106/199] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 23 00:42:33 2022] PUT /identity/v3/projects/c072d440807e45aa8ff63548aa916fc2/users/c76c7bff31e94de3bf9c5ef7250989a8/roles/7ccf4c0abd6b4bf58ad8cca0e05c25a4 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:42:33.987238 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931cc09-35f6-40cf-858f-3f0ca3691548 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:34.094089 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931cc09-35f6-40cf-858f-3f0ca3691548 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:34.101881 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:34.132190 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2809f35-fd5f-41cf-ab27-063ae4f02169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:34.133367 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2809f35-fd5f-41cf-ab27-063ae4f02169 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:34.133651 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2809f35-fd5f-41cf-ab27-063ae4f02169 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:34.133929 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2809f35-fd5f-41cf-ab27-063ae4f02169 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:34.144500 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2809f35-fd5f-41cf-ab27-063ae4f02169 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:42:34.149442 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-d2809f35-fd5f-41cf-ab27-063ae4f02169 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:42:34.149442 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:42:34.149442 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:42:34.149442 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:42:34.149442 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:42:34.149442 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:42:34.149442 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:42:34.149442 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:42:34.149442 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:42:34.149442 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:42:34.149442 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:42:34.149442 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:42:34.149442 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:42:34.149442 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:42:34.149442 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:42:34.149442 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:42:34.150349 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:42:34.150349 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:42:34.150349 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:42:34.150349 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:42:34.150349 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:42:34.150349 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:42:34.150349 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:42:34.150349 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:42:34.150349 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:42:34.150349 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:42:34.150349 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:42:34.150349 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:42:34.150349 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:42:34.150349 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:42:34.150349 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:42:34.150349 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:42:34.151129 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:42:34.151129 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:42:34.151129 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:42:34.151129 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:42:34.151129 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:42:34.151129 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:42:34.151129 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:42:34.151129 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:42:34.151129 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:42:34.151129 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:42:34.151129 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:42:34.151129 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:42:34.151129 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 94/200] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 23 00:42:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:42:34.156587 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601c3f5-08c5-417a-a581-38696c4fe91d None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:34.241039 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:34.264149 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601c3f5-08c5-417a-a581-38696c4fe91d None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:34.299652 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0edb14-ec0e-4e83-8870-0775bc24f6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:34.300285 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0edb14-ec0e-4e83-8870-0775bc24f6b3 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:34.300571 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0edb14-ec0e-4e83-8870-0775bc24f6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:34.300846 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0edb14-ec0e-4e83-8870-0775bc24f6b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:34.301544 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0edb14-ec0e-4e83-8870-0775bc24f6b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:34.301925 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0edb14-ec0e-4e83-8870-0775bc24f6b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:34.303417 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0edb14-ec0e-4e83-8870-0775bc24f6b3 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:34.312064 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 107/201] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 23 00:42:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:34.317745 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2809f35-fd5f-41cf-ab27-063ae4f02169 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:34.422773 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2809f35-fd5f-41cf-ab27-063ae4f02169 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:34.458623 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a646c1c-95f7-4080-9b39-14e2b5826ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:34.459259 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a646c1c-95f7-4080-9b39-14e2b5826ff1 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:34.459542 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a646c1c-95f7-4080-9b39-14e2b5826ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:34.459823 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a646c1c-95f7-4080-9b39-14e2b5826ff1 None admin] PATH_INFO: `/v3/users/7acb259e553f460c93acf53b9f75c9b9` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:34.461025 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a646c1c-95f7-4080-9b39-14e2b5826ff1 None admin] RBAC: Authorizing `identity:get_user(user_id=7acb259e553f460c93acf53b9f75c9b9)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:34.462543 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a646c1c-95f7-4080-9b39-14e2b5826ff1 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:34.464148 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 95/202] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 23 00:42:34 2022] GET /identity/v3/users/7acb259e553f460c93acf53b9f75c9b9 => generated 297 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:34.469932 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0edb14-ec0e-4e83-8870-0775bc24f6b3 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:34.578848 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0edb14-ec0e-4e83-8870-0775bc24f6b3 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:34.614275 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800b244-18f1-4f61-94df-d0b7fbec4953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:34.614897 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800b244-18f1-4f61-94df-d0b7fbec4953 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:34.615177 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800b244-18f1-4f61-94df-d0b7fbec4953 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:34.615449 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800b244-18f1-4f61-94df-d0b7fbec4953 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:34.630404 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:34.688347 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800b244-18f1-4f61-94df-d0b7fbec4953 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:34.689884 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800b244-18f1-4f61-94df-d0b7fbec4953 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:34.793202 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 108/203] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 23 00:42:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 00:42:34.798561 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a646c1c-95f7-4080-9b39-14e2b5826ff1 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:34.835116 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:34.901288 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a646c1c-95f7-4080-9b39-14e2b5826ff1 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:34.935351 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae48b5e-1924-4d01-a40b-c5af608b4406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:34.935990 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae48b5e-1924-4d01-a40b-c5af608b4406 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:34.936271 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae48b5e-1924-4d01-a40b-c5af608b4406 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:34.936543 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae48b5e-1924-4d01-a40b-c5af608b4406 None admin] PATH_INFO: `/v3/projects/c072d440807e45aa8ff63548aa916fc2` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:34.937669 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae48b5e-1924-4d01-a40b-c5af608b4406 None admin] RBAC: Authorizing `identity:get_project(project_id=c072d440807e45aa8ff63548aa916fc2)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:34.939142 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae48b5e-1924-4d01-a40b-c5af608b4406 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:34.941088 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 96/204] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 23 00:42:34 2022] GET /identity/v3/projects/c072d440807e45aa8ff63548aa916fc2 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:42:34.947172 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800b244-18f1-4f61-94df-d0b7fbec4953 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:34.991316 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:35.050289 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800b244-18f1-4f61-94df-d0b7fbec4953 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:35.087863 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c97dda-83bb-4c8c-a567-19144776248b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:35.087863 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c97dda-83bb-4c8c-a567-19144776248b None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:35.087863 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c97dda-83bb-4c8c-a567-19144776248b None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:35.087863 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c97dda-83bb-4c8c-a567-19144776248b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:35.088409 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c97dda-83bb-4c8c-a567-19144776248b None admin] RBAC: Adding query filter params (role.id=130c11043623491c8f8e67ecb6f3efbc, scope.project.id=c072d440807e45aa8ff63548aa916fc2, user.id=7acb259e553f460c93acf53b9f75c9b9) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:35.088710 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c97dda-83bb-4c8c-a567-19144776248b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:35.091990 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c97dda-83bb-4c8c-a567-19144776248b None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:35.096826 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 109/205] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 23 00:42:34 2022] GET /identity/v3/role_assignments?user.id=7acb259e553f460c93acf53b9f75c9b9&scope.project.id=c072d440807e45aa8ff63548aa916fc2&role.id=130c11043623491c8f8e67ecb6f3efbc => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:35.950220 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aeee40-eb01-426f-8ea5-13a32f1572a4 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:35.950753 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aeee40-eb01-426f-8ea5-13a32f1572a4 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:35.950753 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aeee40-eb01-426f-8ea5-13a32f1572a4 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:35.952287 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 97/206] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:42:35.957340 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6f458-67a6-46ec-a7e3-8e492db889cd None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:35.958309 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6f458-67a6-46ec-a7e3-8e492db889cd None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:35.958448 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6f458-67a6-46ec-a7e3-8e492db889cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:35.978850 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-44c6f458-67a6-46ec-a7e3-8e492db889cd None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:35.980356 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-44c6f458-67a6-46ec-a7e3-8e492db889cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:36.024874 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddc712-d8ef-4387-b9d7-847fd7b1480e None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:36.025181 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddc712-d8ef-4387-b9d7-847fd7b1480e None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:36.025428 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddc712-d8ef-4387-b9d7-847fd7b1480e None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:36.027328 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 98/207] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:42:36.032307 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d19f8d-64b9-4d94-a612-635a2e92be24 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:36.032596 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d19f8d-64b9-4d94-a612-635a2e92be24 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:36.032883 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d19f8d-64b9-4d94-a612-635a2e92be24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:36.051853 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-d3d19f8d-64b9-4d94-a612-635a2e92be24 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:36.053036 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-d3d19f8d-64b9-4d94-a612-635a2e92be24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:36.054887 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 110/208] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:42:36.089024 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01b5fd-95d9-4a86-bbb6-6c4023c37265 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:36.089526 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01b5fd-95d9-4a86-bbb6-6c4023c37265 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:36.089950 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01b5fd-95d9-4a86-bbb6-6c4023c37265 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:36.091644 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 111/209] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:42:36.097522 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a3ed3-0d08-442f-8c4a-9bdde3d9159d None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:36.097807 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a3ed3-0d08-442f-8c4a-9bdde3d9159d None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:36.098552 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a3ed3-0d08-442f-8c4a-9bdde3d9159d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:36.118367 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-830a3ed3-0d08-442f-8c4a-9bdde3d9159d None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:36.119547 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-830a3ed3-0d08-442f-8c4a-9bdde3d9159d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:36.126712 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 99/210] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 00:42:36.149908 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:36.188759 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 112/211] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 00:42:36.332249 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d19f8d-64b9-4d94-a612-635a2e92be24 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:36.365381 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:36.400132 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a3ed3-0d08-442f-8c4a-9bdde3d9159d None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:36.439251 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d19f8d-64b9-4d94-a612-635a2e92be24 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:36.475078 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7245f-0a57-4f61-b21e-963781655128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:36.475708 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7245f-0a57-4f61-b21e-963781655128 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:36.475985 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7245f-0a57-4f61-b21e-963781655128 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:36.476256 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7245f-0a57-4f61-b21e-963781655128 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:36.477359 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b7245f-0a57-4f61-b21e-963781655128 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:36.478863 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b7245f-0a57-4f61-b21e-963781655128 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:36.480774 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 100/212] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:42:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:36.485985 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7245f-0a57-4f61-b21e-963781655128 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:36.503515 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a3ed3-0d08-442f-8c4a-9bdde3d9159d None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:36.538150 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394bbac-18b5-4b8d-8afe-c14ca6c8ea2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:36.538792 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394bbac-18b5-4b8d-8afe-c14ca6c8ea2d None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:36.539076 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394bbac-18b5-4b8d-8afe-c14ca6c8ea2d None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:36.539350 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394bbac-18b5-4b8d-8afe-c14ca6c8ea2d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:36.549883 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b394bbac-18b5-4b8d-8afe-c14ca6c8ea2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:42:36.555683 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-b394bbac-18b5-4b8d-8afe-c14ca6c8ea2d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:42:36.555683 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:42:36.555683 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:42:36.555683 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:42:36.555683 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:42:36.555683 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:42:36.555683 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:42:36.555683 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:42:36.555683 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:42:36.555683 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:42:36.555683 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:42:36.555683 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:42:36.555683 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:42:36.555683 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:42:36.555683 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:42:36.555683 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:42:36.556554 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:42:36.556554 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:42:36.556554 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:42:36.556554 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:42:36.556554 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:42:36.556554 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:42:36.556554 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:42:36.556554 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:42:36.556554 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:42:36.556554 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:42:36.556554 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:42:36.556554 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:42:36.556554 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:42:36.556554 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:42:36.556554 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:42:36.556554 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:42:36.557344 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:42:36.557344 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:42:36.557344 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:42:36.557344 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:42:36.557344 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:42:36.557344 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:42:36.557344 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:42:36.557344 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:42:36.557344 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:42:36.557344 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:42:36.557344 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:42:36.557344 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:42:36.557344 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 113/213] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 23 00:42:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:42:36.558013 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394bbac-18b5-4b8d-8afe-c14ca6c8ea2d None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:36.584108 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:36.585979 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:36.587674 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7245f-0a57-4f61-b21e-963781655128 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:36.624050 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b95be-c472-4a8a-8b8f-a918171d7537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:36.624679 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b95be-c472-4a8a-8b8f-a918171d7537 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:36.624964 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b95be-c472-4a8a-8b8f-a918171d7537 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:36.625231 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b95be-c472-4a8a-8b8f-a918171d7537 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:36.636070 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261b95be-c472-4a8a-8b8f-a918171d7537 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:42:36.640933 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-261b95be-c472-4a8a-8b8f-a918171d7537 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 00:42:36.640933 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:42:36.640933 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:42:36.640933 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:42:36.640933 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:42:36.640933 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:42:36.640933 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:42:36.640933 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:42:36.640933 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:42:36.640933 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:42:36.640933 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:42:36.640933 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:42:36.640933 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:42:36.640933 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:42:36.640933 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:42:36.640933 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:42:36.642040 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:42:36.642040 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:42:36.642040 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:42:36.642040 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:42:36.642040 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:42:36.642040 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:42:36.642040 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:42:36.642040 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:42:36.642040 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:42:36.642040 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:42:36.642040 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:42:36.642040 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:42:36.642040 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:42:36.642040 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:42:36.642040 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:42:36.642040 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:42:36.642923 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:42:36.642923 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:42:36.642923 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:42:36.642923 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:42:36.642923 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:42:36.642923 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:42:36.642923 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:42:36.642923 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:42:36.642923 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:42:36.642923 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:42:36.642923 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 00:42:36.642923 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:42:36.642923 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 101/214] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 23 00:42:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:42:36.642923 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b95be-c472-4a8a-8b8f-a918171d7537 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:36.662179 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394bbac-18b5-4b8d-8afe-c14ca6c8ea2d None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:36.697035 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc007f80-845e-455d-a06d-7b5da9a81875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:36.697644 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc007f80-845e-455d-a06d-7b5da9a81875 None admin] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:36.697935 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc007f80-845e-455d-a06d-7b5da9a81875 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:36.698244 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc007f80-845e-455d-a06d-7b5da9a81875 None admin] PATH_INFO: `/v3/users` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:36.698898 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc007f80-845e-455d-a06d-7b5da9a81875 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:36.700389 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc007f80-845e-455d-a06d-7b5da9a81875 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:36.721487 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 114/215] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 23 00:42:36 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:42:36.722659 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc007f80-845e-455d-a06d-7b5da9a81875 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:36.758337 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b95be-c472-4a8a-8b8f-a918171d7537 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:36.799732 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770fc9d-bc5a-4dc4-af04-3e69f525964b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:36.800473 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770fc9d-bc5a-4dc4-af04-3e69f525964b None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:36.800826 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770fc9d-bc5a-4dc4-af04-3e69f525964b None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:36.801741 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770fc9d-bc5a-4dc4-af04-3e69f525964b None admin] PATH_INFO: `/v3/roles` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:36.802538 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770fc9d-bc5a-4dc4-af04-3e69f525964b None admin] RBAC: Adding query filter params (name=member) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:36.802919 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770fc9d-bc5a-4dc4-af04-3e69f525964b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:36.804670 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770fc9d-bc5a-4dc4-af04-3e69f525964b None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:36.814844 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 102/216] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 23 00:42:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:36.821130 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770fc9d-bc5a-4dc4-af04-3e69f525964b None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:36.825020 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:36.848582 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc007f80-845e-455d-a06d-7b5da9a81875 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:36.852659 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:36.887855 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8179fa1-a041-4de6-a1c0-27e414b237f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:36.888494 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8179fa1-a041-4de6-a1c0-27e414b237f3 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:36.888779 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8179fa1-a041-4de6-a1c0-27e414b237f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:36.889058 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8179fa1-a041-4de6-a1c0-27e414b237f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:36.890331 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8179fa1-a041-4de6-a1c0-27e414b237f3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:36.890641 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8179fa1-a041-4de6-a1c0-27e414b237f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:36.892087 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8179fa1-a041-4de6-a1c0-27e414b237f3 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:36.901177 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 115/217] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 23 00:42:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:36.907343 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8179fa1-a041-4de6-a1c0-27e414b237f3 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:36.952215 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770fc9d-bc5a-4dc4-af04-3e69f525964b None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:36.990042 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e2c3b-2dfe-441b-9962-c7e9a0576905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:36.990711 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e2c3b-2dfe-441b-9962-c7e9a0576905 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:36.991506 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e2c3b-2dfe-441b-9962-c7e9a0576905 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:36.991791 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e2c3b-2dfe-441b-9962-c7e9a0576905 None admin] PATH_INFO: `/v3/users/29dfa9feaade4487b2924d1016a97225` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:37.010292 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e2c3b-2dfe-441b-9962-c7e9a0576905 None admin] RBAC: Authorizing `identity:get_user(user_id=29dfa9feaade4487b2924d1016a97225)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:37.012073 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e2c3b-2dfe-441b-9962-c7e9a0576905 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:37.013986 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 103/218] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 23 00:42:36 2022] GET /identity/v3/users/29dfa9feaade4487b2924d1016a97225 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:42:37.021675 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e2c3b-2dfe-441b-9962-c7e9a0576905 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:37.032367 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8179fa1-a041-4de6-a1c0-27e414b237f3 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:37.072929 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5861a98e-977e-4abb-9c2e-1a989937c16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:37.073581 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861a98e-977e-4abb-9c2e-1a989937c16b None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:37.073961 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861a98e-977e-4abb-9c2e-1a989937c16b None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:37.074168 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861a98e-977e-4abb-9c2e-1a989937c16b None admin] PATH_INFO: `/v3/users/c76c7bff31e94de3bf9c5ef7250989a8` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:37.075329 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5861a98e-977e-4abb-9c2e-1a989937c16b None admin] RBAC: Authorizing `identity:get_user(user_id=c76c7bff31e94de3bf9c5ef7250989a8)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:37.076791 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5861a98e-977e-4abb-9c2e-1a989937c16b None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:37.078978 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 116/219] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 23 00:42:36 2022] GET /identity/v3/users/c76c7bff31e94de3bf9c5ef7250989a8 => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:37.083905 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5861a98e-977e-4abb-9c2e-1a989937c16b None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:37.108481 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:37.124417 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:37.145809 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e2c3b-2dfe-441b-9962-c7e9a0576905 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:37.183764 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe063ec-83a9-40f3-8397-1086b5e1a7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:37.184376 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe063ec-83a9-40f3-8397-1086b5e1a7cf None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:37.184656 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe063ec-83a9-40f3-8397-1086b5e1a7cf None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:37.184931 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe063ec-83a9-40f3-8397-1086b5e1a7cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:37.185715 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe063ec-83a9-40f3-8397-1086b5e1a7cf None admin] RBAC: Adding query filter params (role.id=130c11043623491c8f8e67ecb6f3efbc, user.id=29dfa9feaade4487b2924d1016a97225, scope.system=all) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:37.186027 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe063ec-83a9-40f3-8397-1086b5e1a7cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:37.187716 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe063ec-83a9-40f3-8397-1086b5e1a7cf None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:37.193932 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 104/220] 10.222.0.23 () {56 vars in 1308 bytes} [Sun Oct 23 00:42:37 2022] GET /identity/v3/role_assignments?user.id=29dfa9feaade4487b2924d1016a97225&scope.system=all&role.id=130c11043623491c8f8e67ecb6f3efbc => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:42:37.214059 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5861a98e-977e-4abb-9c2e-1a989937c16b None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:37.255374 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40065ee7-8a1b-4f6a-ac29-f35081d3ab04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:37.256376 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40065ee7-8a1b-4f6a-ac29-f35081d3ab04 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:37.256867 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40065ee7-8a1b-4f6a-ac29-f35081d3ab04 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:37.257340 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40065ee7-8a1b-4f6a-ac29-f35081d3ab04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:37.339351 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40065ee7-8a1b-4f6a-ac29-f35081d3ab04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:37.340807 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40065ee7-8a1b-4f6a-ac29-f35081d3ab04 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:37.357055 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:37.448520 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 117/221] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 23 00:42:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 23 00:42:37.454308 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe063ec-83a9-40f3-8397-1086b5e1a7cf None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:37.559809 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe063ec-83a9-40f3-8397-1086b5e1a7cf None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:37.595258 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df593d2d-5cde-47c5-bcc3-4862715fc8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:37.595821 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df593d2d-5cde-47c5-bcc3-4862715fc8ac None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:37.596104 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df593d2d-5cde-47c5-bcc3-4862715fc8ac None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:37.596377 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df593d2d-5cde-47c5-bcc3-4862715fc8ac None admin] PATH_INFO: `/v3/projects/c072d440807e45aa8ff63548aa916fc2` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:37.597533 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df593d2d-5cde-47c5-bcc3-4862715fc8ac None admin] RBAC: Authorizing `identity:get_project(project_id=c072d440807e45aa8ff63548aa916fc2)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:37.599557 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df593d2d-5cde-47c5-bcc3-4862715fc8ac None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:37.604880 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 105/222] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 23 00:42:37 2022] GET /identity/v3/projects/c072d440807e45aa8ff63548aa916fc2 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:37.607803 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40065ee7-8a1b-4f6a-ac29-f35081d3ab04 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:37.715938 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40065ee7-8a1b-4f6a-ac29-f35081d3ab04 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:37.732399 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:37.755142 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b889b-bc49-407a-9a84-589d2132b841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:37.756072 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b889b-bc49-407a-9a84-589d2132b841 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:37.756588 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b889b-bc49-407a-9a84-589d2132b841 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:37.757059 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b889b-bc49-407a-9a84-589d2132b841 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:37.757983 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b889b-bc49-407a-9a84-589d2132b841 None admin] RBAC: Adding query filter params (role.id=7ccf4c0abd6b4bf58ad8cca0e05c25a4, scope.project.id=c072d440807e45aa8ff63548aa916fc2, user.id=c76c7bff31e94de3bf9c5ef7250989a8) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:37.758547 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b889b-bc49-407a-9a84-589d2132b841 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:37.760249 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b889b-bc49-407a-9a84-589d2132b841 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:37.766589 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 118/223] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 23 00:42:37 2022] GET /identity/v3/role_assignments?user.id=c76c7bff31e94de3bf9c5ef7250989a8&scope.project.id=c072d440807e45aa8ff63548aa916fc2&role.id=7ccf4c0abd6b4bf58ad8cca0e05c25a4 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:39.077335 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886bdbbb-7e9e-481e-832f-e4a22bf573b2 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:39.077882 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886bdbbb-7e9e-481e-832f-e4a22bf573b2 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:39.077882 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886bdbbb-7e9e-481e-832f-e4a22bf573b2 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:39.079410 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 106/224] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:42:39.084526 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93946f1b-b331-4a25-8963-88bb3bac6849 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:39.084899 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93946f1b-b331-4a25-8963-88bb3bac6849 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:39.085089 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93946f1b-b331-4a25-8963-88bb3bac6849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:39.104063 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-93946f1b-b331-4a25-8963-88bb3bac6849 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:39.105097 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-93946f1b-b331-4a25-8963-88bb3bac6849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:39.151182 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f9809-fdf1-4758-80b6-071da142cbec None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:39.151548 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f9809-fdf1-4758-80b6-071da142cbec None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:39.151750 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f9809-fdf1-4758-80b6-071da142cbec None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:39.153215 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 107/225] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:42:39.158220 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a7845-29e0-4929-aff3-c66b446be90d None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:39.158517 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a7845-29e0-4929-aff3-c66b446be90d None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:39.158797 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a7845-29e0-4929-aff3-c66b446be90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:39.176143 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 119/226] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:42:39.179196 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-259a7845-29e0-4929-aff3-c66b446be90d None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:39.180650 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-259a7845-29e0-4929-aff3-c66b446be90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:39.189186 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:39.256644 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 108/227] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 00:42:39.412009 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366820c-2d51-42fe-9197-86b91c884f57 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:39.412367 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366820c-2d51-42fe-9197-86b91c884f57 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:39.412563 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366820c-2d51-42fe-9197-86b91c884f57 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:39.414070 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 120/228] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:42:39.419066 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9d280-e7c2-4f48-bf69-807c63f6b428 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:39.419355 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9d280-e7c2-4f48-bf69-807c63f6b428 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:39.419625 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9d280-e7c2-4f48-bf69-807c63f6b428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:39.438219 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-1fb9d280-e7c2-4f48-bf69-807c63f6b428 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:39.439403 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-1fb9d280-e7c2-4f48-bf69-807c63f6b428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:39.445880 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366820c-2d51-42fe-9197-86b91c884f57 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:39.511765 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 109/229] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:42:39.523022 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9d280-e7c2-4f48-bf69-807c63f6b428 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:39.557886 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366820c-2d51-42fe-9197-86b91c884f57 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:39.565222 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:39.592473 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ac2b4-225b-44ae-aa80-c5f88d2f1def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:39.593102 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ac2b4-225b-44ae-aa80-c5f88d2f1def None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:39.593383 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ac2b4-225b-44ae-aa80-c5f88d2f1def None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:39.593659 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ac2b4-225b-44ae-aa80-c5f88d2f1def None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:39.598686 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:39.604339 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370ac2b4-225b-44ae-aa80-c5f88d2f1def None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:42:39.609538 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-370ac2b4-225b-44ae-aa80-c5f88d2f1def None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 00:42:39.609538 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:42:39.609538 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:42:39.609538 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:42:39.609538 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:42:39.609538 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:42:39.609538 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:42:39.609538 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:42:39.609538 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:42:39.609538 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:42:39.609538 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:42:39.609538 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:42:39.609538 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:42:39.609538 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:42:39.609538 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:42:39.609538 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:42:39.610551 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:42:39.610551 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:42:39.610551 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:42:39.610551 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:42:39.610551 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:42:39.610551 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:42:39.610551 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:42:39.610551 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:42:39.610551 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:42:39.610551 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:42:39.610551 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:42:39.610551 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:42:39.610551 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:42:39.610551 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:42:39.610551 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:42:39.610551 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:42:39.611364 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:42:39.611364 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:42:39.611364 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:42:39.611364 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:42:39.611364 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:42:39.611364 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:42:39.611364 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:42:39.611364 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:42:39.611364 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:42:39.611364 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:42:39.611364 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 00:42:39.611364 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:42:39.611364 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 121/230] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 23 00:42:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:42:39.616967 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ac2b4-225b-44ae-aa80-c5f88d2f1def None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:39.635912 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9d280-e7c2-4f48-bf69-807c63f6b428 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:39.671959 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe3d58-20a5-4153-9a7d-172ab68ffda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:39.672626 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe3d58-20a5-4153-9a7d-172ab68ffda0 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:39.673026 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe3d58-20a5-4153-9a7d-172ab68ffda0 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:39.673305 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe3d58-20a5-4153-9a7d-172ab68ffda0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:39.675918 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe3d58-20a5-4153-9a7d-172ab68ffda0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:39.678031 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe3d58-20a5-4153-9a7d-172ab68ffda0 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:39.680036 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 110/231] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:42:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:42:39.685249 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe3d58-20a5-4153-9a7d-172ab68ffda0 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:39.719917 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ac2b4-225b-44ae-aa80-c5f88d2f1def None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:39.755701 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00c93c6-0836-4f23-9872-b811b59998fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:39.756523 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c93c6-0836-4f23-9872-b811b59998fd None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:39.756805 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c93c6-0836-4f23-9872-b811b59998fd None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:39.757075 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c93c6-0836-4f23-9872-b811b59998fd None admin] PATH_INFO: `/v3/roles` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:39.757745 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00c93c6-0836-4f23-9872-b811b59998fd None admin] RBAC: Adding query filter params (name=reader) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:39.758049 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00c93c6-0836-4f23-9872-b811b59998fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:39.759466 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00c93c6-0836-4f23-9872-b811b59998fd None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:39.767755 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 122/232] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 23 00:42:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:42:39.773383 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00c93c6-0836-4f23-9872-b811b59998fd None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:39.795967 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe3d58-20a5-4153-9a7d-172ab68ffda0 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:39.802434 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:39.829970 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39a2e0-9bbf-46e7-92ee-272f54c181fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:39.830606 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39a2e0-9bbf-46e7-92ee-272f54c181fd None admin] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:39.830888 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39a2e0-9bbf-46e7-92ee-272f54c181fd None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:39.831162 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39a2e0-9bbf-46e7-92ee-272f54c181fd None admin] PATH_INFO: `/v3/groups` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:39.831793 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af39a2e0-9bbf-46e7-92ee-272f54c181fd None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:39.833262 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af39a2e0-9bbf-46e7-92ee-272f54c181fd None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:39.845405 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:39.858305 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 111/233] 10.222.0.23 () {60 vars in 1134 bytes} [Sun Oct 23 00:42:39 2022] POST /identity/v3/groups => generated 229 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:42:39.859344 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39a2e0-9bbf-46e7-92ee-272f54c181fd None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:39.877716 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00c93c6-0836-4f23-9872-b811b59998fd None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:39.917826 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b92c6-776e-4e08-9e23-835df582bf88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:39.918835 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b92c6-776e-4e08-9e23-835df582bf88 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:39.919118 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b92c6-776e-4e08-9e23-835df582bf88 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:39.919421 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b92c6-776e-4e08-9e23-835df582bf88 None admin] PATH_INFO: `/v3/users/d833a85b42894ac596a88150d9a9e52c` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:39.935238 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01b92c6-776e-4e08-9e23-835df582bf88 None admin] RBAC: Authorizing `identity:get_user(user_id=d833a85b42894ac596a88150d9a9e52c)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:39.936722 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01b92c6-776e-4e08-9e23-835df582bf88 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:39.938479 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 123/234] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 23 00:42:39 2022] GET /identity/v3/users/d833a85b42894ac596a88150d9a9e52c => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:42:39.944568 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b92c6-776e-4e08-9e23-835df582bf88 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:39.984974 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39a2e0-9bbf-46e7-92ee-272f54c181fd None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:40.022057 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea15f74-f25a-4396-ae6e-a8044ee6843f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:40.024088 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea15f74-f25a-4396-ae6e-a8044ee6843f None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:40.024088 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea15f74-f25a-4396-ae6e-a8044ee6843f None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:40.024088 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea15f74-f25a-4396-ae6e-a8044ee6843f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:40.034217 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea15f74-f25a-4396-ae6e-a8044ee6843f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:42:40.040520 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-1ea15f74-f25a-4396-ae6e-a8044ee6843f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:42:40.040520 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:42:40.040520 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:42:40.040520 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:42:40.040520 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:42:40.040520 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:42:40.040520 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:42:40.040520 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:42:40.040520 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:42:40.040520 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:42:40.040520 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:42:40.040520 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:42:40.040520 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:42:40.040520 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:42:40.040520 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:42:40.040520 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:42:40.041541 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:42:40.041541 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:42:40.041541 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:42:40.041541 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:42:40.041541 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:42:40.041541 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:42:40.041541 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:42:40.041541 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:42:40.041541 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:42:40.041541 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:42:40.041541 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:42:40.041541 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:42:40.041541 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:42:40.041541 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:42:40.041541 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:42:40.041541 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:42:40.042425 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:42:40.042425 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:42:40.042425 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:42:40.042425 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:42:40.042425 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:42:40.042425 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:42:40.042425 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:42:40.042425 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:42:40.042425 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:42:40.042425 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:42:40.042425 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:42:40.042425 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:42:40.042425 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 112/235] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 23 00:42:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:42:40.049888 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea15f74-f25a-4396-ae6e-a8044ee6843f None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:40.052628 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:40.070301 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b92c6-776e-4e08-9e23-835df582bf88 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:40.108286 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e853a144-2f13-44bc-890b-ced633a3c757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:40.108934 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853a144-2f13-44bc-890b-ced633a3c757 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:40.109159 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853a144-2f13-44bc-890b-ced633a3c757 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:40.109432 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853a144-2f13-44bc-890b-ced633a3c757 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:40.110209 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e853a144-2f13-44bc-890b-ced633a3c757 None admin] RBAC: Adding query filter params (role.id=7ccf4c0abd6b4bf58ad8cca0e05c25a4, user.id=d833a85b42894ac596a88150d9a9e52c, scope.system=all) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:40.110524 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e853a144-2f13-44bc-890b-ced633a3c757 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:40.111952 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e853a144-2f13-44bc-890b-ced633a3c757 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:40.114583 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:40.118742 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 124/236] 10.222.0.23 () {56 vars in 1308 bytes} [Sun Oct 23 00:42:39 2022] GET /identity/v3/role_assignments?user.id=d833a85b42894ac596a88150d9a9e52c&scope.system=all&role.id=7ccf4c0abd6b4bf58ad8cca0e05c25a4 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:42:40.166508 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea15f74-f25a-4396-ae6e-a8044ee6843f None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:40.203784 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d6126-5366-4137-bd68-363f07a3c527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:40.204317 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d6126-5366-4137-bd68-363f07a3c527 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:40.204595 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d6126-5366-4137-bd68-363f07a3c527 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:40.204866 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d6126-5366-4137-bd68-363f07a3c527 None admin] PATH_INFO: `/v3/roles` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:40.205549 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9d6126-5366-4137-bd68-363f07a3c527 None admin] RBAC: Adding query filter params (name=member) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:40.205849 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9d6126-5366-4137-bd68-363f07a3c527 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:40.207342 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9d6126-5366-4137-bd68-363f07a3c527 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:40.216999 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 113/237] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 23 00:42:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:42:40.224677 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e853a144-2f13-44bc-890b-ced633a3c757 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:40.335733 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e853a144-2f13-44bc-890b-ced633a3c757 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:40.370606 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393f0c0-ebd0-4647-bbde-390e01385c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:40.371242 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393f0c0-ebd0-4647-bbde-390e01385c42 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:40.371521 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393f0c0-ebd0-4647-bbde-390e01385c42 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:40.371791 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393f0c0-ebd0-4647-bbde-390e01385c42 None admin] PATH_INFO: `/v3/users/29dfa9feaade4487b2924d1016a97225` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:40.372907 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a393f0c0-ebd0-4647-bbde-390e01385c42 None admin] RBAC: Authorizing `identity:get_user(user_id=29dfa9feaade4487b2924d1016a97225)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:40.374379 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a393f0c0-ebd0-4647-bbde-390e01385c42 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:40.376186 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 125/238] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 23 00:42:40 2022] GET /identity/v3/users/29dfa9feaade4487b2924d1016a97225 => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:40.381567 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d6126-5366-4137-bd68-363f07a3c527 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:40.484388 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d6126-5366-4137-bd68-363f07a3c527 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:40.507310 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:40.519839 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f62f5-563a-4d2e-b63d-c07843ea1b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:40.520595 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f62f5-563a-4d2e-b63d-c07843ea1b4a None admin] REQUEST_METHOD: `PUT` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:40.520883 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f62f5-563a-4d2e-b63d-c07843ea1b4a None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:40.521162 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f62f5-563a-4d2e-b63d-c07843ea1b4a None admin] PATH_INFO: `/v3/system/users/29dfa9feaade4487b2924d1016a97225/roles/130c11043623491c8f8e67ecb6f3efbc` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:40.522693 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1f62f5-563a-4d2e-b63d-c07843ea1b4a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=29dfa9feaade4487b2924d1016a97225, role_id=130c11043623491c8f8e67ecb6f3efbc)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:40.524156 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1f62f5-563a-4d2e-b63d-c07843ea1b4a None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:40.538108 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 114/239] 10.222.0.23 () {58 vars in 1334 bytes} [Sun Oct 23 00:42:40 2022] PUT /identity/v3/system/users/29dfa9feaade4487b2924d1016a97225/roles/130c11043623491c8f8e67ecb6f3efbc => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:42:42.035255 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bcadf1-ea95-43c8-bd04-c4ab6ee50e8a None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:42.036302 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bcadf1-ea95-43c8-bd04-c4ab6ee50e8a None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:42.036378 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bcadf1-ea95-43c8-bd04-c4ab6ee50e8a None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:42.037865 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 126/240] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:42:42.042803 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf34ffb-9a40-4841-bc5f-f6f90439f3cd None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:42.043214 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf34ffb-9a40-4841-bc5f-f6f90439f3cd None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:42.043387 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf34ffb-9a40-4841-bc5f-f6f90439f3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:42.062650 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-4cf34ffb-9a40-4841-bc5f-f6f90439f3cd None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:42.063842 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-4cf34ffb-9a40-4841-bc5f-f6f90439f3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:42.132627 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 115/241] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:42:42.277480 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c92d00-1985-405a-a95a-27ff40764309 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:42.277789 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c92d00-1985-405a-a95a-27ff40764309 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:42.278043 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c92d00-1985-405a-a95a-27ff40764309 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:42.279606 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 127/242] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:42:42.284458 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5956a3-d9dc-4518-8e1d-82b67df99b42 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:42.284749 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5956a3-d9dc-4518-8e1d-82b67df99b42 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:42.285021 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5956a3-d9dc-4518-8e1d-82b67df99b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:42.304957 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-ce5956a3-d9dc-4518-8e1d-82b67df99b42 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:42.306098 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-ce5956a3-d9dc-4518-8e1d-82b67df99b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:42.373424 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 116/243] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:42:42.401439 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c92d00-1985-405a-a95a-27ff40764309 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:42.421215 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:42.507701 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c92d00-1985-405a-a95a-27ff40764309 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:42.541075 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9711b81-5368-4afa-b936-dc1f531609dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:42.541730 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9711b81-5368-4afa-b936-dc1f531609dd None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:42.542009 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9711b81-5368-4afa-b936-dc1f531609dd None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:42.542310 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9711b81-5368-4afa-b936-dc1f531609dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:42.543473 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9711b81-5368-4afa-b936-dc1f531609dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:42.544971 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9711b81-5368-4afa-b936-dc1f531609dd None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:42.546939 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 128/244] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:42:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:42.552966 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5956a3-d9dc-4518-8e1d-82b67df99b42 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:42.601667 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:42.648420 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9711b81-5368-4afa-b936-dc1f531609dd None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:42.657038 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5956a3-d9dc-4518-8e1d-82b67df99b42 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:42.691715 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde7603-c738-4d84-962a-cab46fa59fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:42.692876 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde7603-c738-4d84-962a-cab46fa59fd4 None admin] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:42.693156 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde7603-c738-4d84-962a-cab46fa59fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:42.693434 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde7603-c738-4d84-962a-cab46fa59fd4 None admin] PATH_INFO: `/v3/groups` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:42.694066 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cde7603-c738-4d84-962a-cab46fa59fd4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:42.695537 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cde7603-c738-4d84-962a-cab46fa59fd4 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:42.712313 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 117/245] 10.222.0.23 () {60 vars in 1134 bytes} [Sun Oct 23 00:42:42 2022] POST /identity/v3/groups => generated 226 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:42:42.713505 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b57b5-ef3e-4287-bb0d-2d6f33713639 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:42.713793 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b57b5-ef3e-4287-bb0d-2d6f33713639 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:42.714068 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b57b5-ef3e-4287-bb0d-2d6f33713639 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:42.715503 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 118/246] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:42:42.727911 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f04a0e-d7dd-44ad-adb9-25274a3f9853 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:42.728252 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f04a0e-d7dd-44ad-adb9-25274a3f9853 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:42.728467 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f04a0e-d7dd-44ad-adb9-25274a3f9853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:42.742492 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:42.749105 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-d5f04a0e-d7dd-44ad-adb9-25274a3f9853 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:42.750383 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-d5f04a0e-d7dd-44ad-adb9-25274a3f9853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:42.762236 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9711b81-5368-4afa-b936-dc1f531609dd None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:42.806888 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb4433-d955-4a95-9f4b-25971b42dfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:42.807545 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb4433-d955-4a95-9f4b-25971b42dfbf None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:42.807830 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb4433-d955-4a95-9f4b-25971b42dfbf None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:42.808109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb4433-d955-4a95-9f4b-25971b42dfbf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:42.819621 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb4433-d955-4a95-9f4b-25971b42dfbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:42:42.824602 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-14bb4433-d955-4a95-9f4b-25971b42dfbf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 00:42:42.824602 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:42:42.824602 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:42:42.824602 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:42:42.824602 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:42:42.824602 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:42:42.824602 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:42:42.824602 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:42:42.824602 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:42:42.824602 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:42:42.824602 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:42:42.824602 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:42:42.824602 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:42:42.824602 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:42:42.824602 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:42:42.824602 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:42:42.825513 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:42:42.825513 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:42:42.825513 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:42:42.825513 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:42:42.825513 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:42:42.825513 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:42:42.825513 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:42:42.825513 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:42:42.825513 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:42:42.825513 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:42:42.825513 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:42:42.825513 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:42:42.825513 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:42:42.825513 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:42:42.825513 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:42:42.825513 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:42:42.826666 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:42:42.826666 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:42:42.826666 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:42:42.826666 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:42:42.826666 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:42:42.826666 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:42:42.826666 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:42:42.826666 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:42:42.826666 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:42:42.826666 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:42:42.826666 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 00:42:42.826666 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:42:42.826666 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 129/247] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 23 00:42:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:42:42.831706 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb4433-d955-4a95-9f4b-25971b42dfbf None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:42.836927 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 119/248] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 00:42:42.947114 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb4433-d955-4a95-9f4b-25971b42dfbf None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:42.982828 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ebd686-e15e-4743-9145-e825db6c253f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:42.983448 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebd686-e15e-4743-9145-e825db6c253f None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:42.983731 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebd686-e15e-4743-9145-e825db6c253f None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:42.984007 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebd686-e15e-4743-9145-e825db6c253f None admin] PATH_INFO: `/v3/roles` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:42.984685 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ebd686-e15e-4743-9145-e825db6c253f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:42.984989 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ebd686-e15e-4743-9145-e825db6c253f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:42.988599 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ebd686-e15e-4743-9145-e825db6c253f None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:42.996597 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 130/249] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 23 00:42:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:42:43.002524 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f04a0e-d7dd-44ad-adb9-25274a3f9853 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:43.047236 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:43.113277 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ebd686-e15e-4743-9145-e825db6c253f None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:43.123167 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f04a0e-d7dd-44ad-adb9-25274a3f9853 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:43.130012 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:43.165532 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe15b3d-f4e3-4cca-a6e2-fec03c2cc474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:43.166697 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe15b3d-f4e3-4cca-a6e2-fec03c2cc474 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:43.167127 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe15b3d-f4e3-4cca-a6e2-fec03c2cc474 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:43.167546 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe15b3d-f4e3-4cca-a6e2-fec03c2cc474 None admin] PATH_INFO: `/v3/users/d833a85b42894ac596a88150d9a9e52c` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:43.169762 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe15b3d-f4e3-4cca-a6e2-fec03c2cc474 None admin] RBAC: Authorizing `identity:get_user(user_id=d833a85b42894ac596a88150d9a9e52c)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:43.171497 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe15b3d-f4e3-4cca-a6e2-fec03c2cc474 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:43.173748 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 120/250] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 23 00:42:43 2022] GET /identity/v3/users/d833a85b42894ac596a88150d9a9e52c => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:43.180227 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe15b3d-f4e3-4cca-a6e2-fec03c2cc474 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:43.273983 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ebd686-e15e-4743-9145-e825db6c253f None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:43.315853 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe15b3d-f4e3-4cca-a6e2-fec03c2cc474 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:43.321000 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:43.329946 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e2ab4-14bb-467c-b8ff-610aa32e9863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:43.331014 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e2ab4-14bb-467c-b8ff-610aa32e9863 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:43.331310 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e2ab4-14bb-467c-b8ff-610aa32e9863 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:43.331595 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e2ab4-14bb-467c-b8ff-610aa32e9863 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:43.348226 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e2ab4-14bb-467c-b8ff-610aa32e9863 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:42:43.356868 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-f47e2ab4-14bb-467c-b8ff-610aa32e9863 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:42:43.356868 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:42:43.356868 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:42:43.356868 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:42:43.356868 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:42:43.356868 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:42:43.356868 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:42:43.356868 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:42:43.356868 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:42:43.356868 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:42:43.356868 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:42:43.356868 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:42:43.356868 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:42:43.356868 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:42:43.356868 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:42:43.356868 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:42:43.357780 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:42:43.357780 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:42:43.357780 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:42:43.357780 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:42:43.357780 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:42:43.357780 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:42:43.357780 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:42:43.357780 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:42:43.357780 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:42:43.357780 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:42:43.357780 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:42:43.357780 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:42:43.357780 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:42:43.357780 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:42:43.357780 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:42:43.357780 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:42:43.358600 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:42:43.358600 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:42:43.358600 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:42:43.358600 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:42:43.358600 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:42:43.358600 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:42:43.358600 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:42:43.358600 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:42:43.358600 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:42:43.358600 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:42:43.358600 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:42:43.358600 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:42:43.359206 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 131/251] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 23 00:42:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:42:43.366109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e2ab4-14bb-467c-b8ff-610aa32e9863 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:43.369742 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e700e-8d48-42fb-99fa-c42b9165e124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:43.370553 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e700e-8d48-42fb-99fa-c42b9165e124 None admin] REQUEST_METHOD: `PUT` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:43.370834 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e700e-8d48-42fb-99fa-c42b9165e124 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:43.371107 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e700e-8d48-42fb-99fa-c42b9165e124 None admin] PATH_INFO: `/v3/system/users/d833a85b42894ac596a88150d9a9e52c/roles/7ccf4c0abd6b4bf58ad8cca0e05c25a4` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:43.372558 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e700e-8d48-42fb-99fa-c42b9165e124 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d833a85b42894ac596a88150d9a9e52c, role_id=7ccf4c0abd6b4bf58ad8cca0e05c25a4)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:43.373958 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e700e-8d48-42fb-99fa-c42b9165e124 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:43.388769 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 121/252] 10.222.0.23 () {58 vars in 1334 bytes} [Sun Oct 23 00:42:43 2022] PUT /identity/v3/system/users/d833a85b42894ac596a88150d9a9e52c/roles/7ccf4c0abd6b4bf58ad8cca0e05c25a4 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:42:43.443721 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:43.482837 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e2ab4-14bb-467c-b8ff-610aa32e9863 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:43.522394 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b173462-f080-4f32-ad5e-4ecd3d02834e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:43.523019 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b173462-f080-4f32-ad5e-4ecd3d02834e None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:43.523304 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b173462-f080-4f32-ad5e-4ecd3d02834e None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:43.523582 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b173462-f080-4f32-ad5e-4ecd3d02834e None admin] PATH_INFO: `/v3/roles` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:43.524266 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b173462-f080-4f32-ad5e-4ecd3d02834e None admin] RBAC: Adding query filter params (name=member) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:43.524573 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b173462-f080-4f32-ad5e-4ecd3d02834e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:43.525992 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b173462-f080-4f32-ad5e-4ecd3d02834e None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:43.535591 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 132/253] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 23 00:42:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:43.541505 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e700e-8d48-42fb-99fa-c42b9165e124 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:43.660556 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e700e-8d48-42fb-99fa-c42b9165e124 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:43.697712 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d668b5-cb4c-4b8c-9291-3526914497e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:43.698698 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d668b5-cb4c-4b8c-9291-3526914497e6 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:43.699161 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d668b5-cb4c-4b8c-9291-3526914497e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:43.699614 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d668b5-cb4c-4b8c-9291-3526914497e6 None admin] PATH_INFO: `/v3/users/29dfa9feaade4487b2924d1016a97225` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:43.700943 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d668b5-cb4c-4b8c-9291-3526914497e6 None admin] RBAC: Authorizing `identity:get_user(user_id=29dfa9feaade4487b2924d1016a97225)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:43.702632 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d668b5-cb4c-4b8c-9291-3526914497e6 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:43.705044 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 122/254] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 23 00:42:43 2022] GET /identity/v3/users/29dfa9feaade4487b2924d1016a97225 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:43.710816 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b173462-f080-4f32-ad5e-4ecd3d02834e None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:43.834440 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b173462-f080-4f32-ad5e-4ecd3d02834e None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:43.879489 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:43.886226 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf4dd7-5eac-4d8d-b561-46ce29e38741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:43.886845 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf4dd7-5eac-4d8d-b561-46ce29e38741 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:43.887133 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf4dd7-5eac-4d8d-b561-46ce29e38741 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:43.887478 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf4dd7-5eac-4d8d-b561-46ce29e38741 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:43.888130 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf4dd7-5eac-4d8d-b561-46ce29e38741 None admin] RBAC: Adding query filter params (role.id=130c11043623491c8f8e67ecb6f3efbc, user.id=29dfa9feaade4487b2924d1016a97225, scope.system=all) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:43.888438 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf4dd7-5eac-4d8d-b561-46ce29e38741 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:43.889961 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf4dd7-5eac-4d8d-b561-46ce29e38741 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:43.905497 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 133/255] 10.222.0.23 () {56 vars in 1308 bytes} [Sun Oct 23 00:42:43 2022] GET /identity/v3/role_assignments?user.id=29dfa9feaade4487b2924d1016a97225&scope.system=all&role.id=130c11043623491c8f8e67ecb6f3efbc => generated 510 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:45.181080 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5676c8-9f37-4fc4-bcde-995e9251f9a5 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:45.181596 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5676c8-9f37-4fc4-bcde-995e9251f9a5 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:45.181699 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5676c8-9f37-4fc4-bcde-995e9251f9a5 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:45.183319 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 123/256] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:42:45.188459 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497a695-bc1e-4f5a-b7c3-e44869294573 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:45.188866 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497a695-bc1e-4f5a-b7c3-e44869294573 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:45.189036 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497a695-bc1e-4f5a-b7c3-e44869294573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:45.215049 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-9497a695-bc1e-4f5a-b7c3-e44869294573 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:45.216256 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-9497a695-bc1e-4f5a-b7c3-e44869294573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:45.289551 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 134/257] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 23 00:42:45.824093 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5676c8-9f37-4fc4-bcde-995e9251f9a5 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:45.837470 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5676c8-9f37-4fc4-bcde-995e9251f9a5 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:45.842280 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff1e7b-7804-4574-ad20-27711c694465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:45.842921 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff1e7b-7804-4574-ad20-27711c694465 admin admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:45.843201 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff1e7b-7804-4574-ad20-27711c694465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:45.843474 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff1e7b-7804-4574-ad20-27711c694465 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:45.861794 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecff1e7b-7804-4574-ad20-27711c694465 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:42:45.871067 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-ecff1e7b-7804-4574-ad20-27711c694465 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:42:45.871067 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:42:45.871067 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:42:45.871067 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:42:45.871067 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:42:45.871067 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:42:45.871067 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:42:45.871067 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:42:45.871067 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:42:45.871067 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:42:45.871067 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:42:45.871067 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:42:45.871067 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:42:45.871067 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:42:45.871067 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:42:45.871067 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:42:45.872003 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:42:45.872003 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:42:45.872003 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:42:45.872003 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:42:45.872003 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:42:45.872003 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:42:45.872003 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:42:45.872003 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:42:45.872003 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:42:45.872003 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:42:45.872003 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:42:45.872003 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:42:45.872003 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:42:45.872003 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:42:45.872003 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:42:45.872003 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:42:45.872806 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:42:45.872806 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:42:45.872806 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:42:45.872806 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:42:45.872806 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:42:45.872806 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:42:45.872806 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:42:45.872806 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:42:45.872806 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:42:45.872806 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:42:45.872806 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:42:45.872806 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:42:45.872806 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 124/258] 10.222.0.23 () {56 vars in 1120 bytes} [Sun Oct 23 00:42:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:42:45.880470 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497a695-bc1e-4f5a-b7c3-e44869294573 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:45.896088 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497a695-bc1e-4f5a-b7c3-e44869294573 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:45.900743 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc6f97-47be-4885-94e8-7830014962f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:45.901366 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc6f97-47be-4885-94e8-7830014962f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:45.901650 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc6f97-47be-4885-94e8-7830014962f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:45.901933 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc6f97-47be-4885-94e8-7830014962f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:45.902636 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc6f97-47be-4885-94e8-7830014962f0 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:45.902941 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc6f97-47be-4885-94e8-7830014962f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:45.904737 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: WARNING py.warnings [None req-81bc6f97-47be-4885-94e8-7830014962f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 00:42:45.904737 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: warnings.warn(msg) Oct 23 00:42:45.904737 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: Oct 23 00:42:45.905657 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc6f97-47be-4885-94e8-7830014962f0 admin admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:45.918260 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 135/259] 10.222.0.23 () {56 vars in 1122 bytes} [Sun Oct 23 00:42:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:45.923810 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff1e7b-7804-4574-ad20-27711c694465 admin admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:45.934719 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff1e7b-7804-4574-ad20-27711c694465 admin admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:45.936766 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192fd599-1059-4fba-9bbf-f3d109640640 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:45.937055 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192fd599-1059-4fba-9bbf-f3d109640640 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:45.937334 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192fd599-1059-4fba-9bbf-f3d109640640 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:45.944138 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 136/260] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:42:45.947318 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9876d4c5-1fa0-4a57-bd8f-c8dd03779eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:45.948047 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876d4c5-1fa0-4a57-bd8f-c8dd03779eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:45.948335 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876d4c5-1fa0-4a57-bd8f-c8dd03779eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:45.948611 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876d4c5-1fa0-4a57-bd8f-c8dd03779eb3 admin admin] PATH_INFO: `/v3/groups/c5265fb9959c4b70b9b5f282160f6827` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:45.950416 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c2f55-c65a-4d07-b112-6b21caff2e93 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:45.950697 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c2f55-c65a-4d07-b112-6b21caff2e93 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:45.950969 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c2f55-c65a-4d07-b112-6b21caff2e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:45.977459 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9876d4c5-1fa0-4a57-bd8f-c8dd03779eb3 admin admin] RBAC: Authorizing `identity:get_group(group_id=c5265fb9959c4b70b9b5f282160f6827)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:45.979325 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: WARNING py.warnings [None req-9876d4c5-1fa0-4a57-bd8f-c8dd03779eb3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 00:42:45.979325 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: warnings.warn(msg) Oct 23 00:42:45.979325 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: Oct 23 00:42:45.980843 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9876d4c5-1fa0-4a57-bd8f-c8dd03779eb3 admin admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:45.986433 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 125/261] 10.222.0.23 () {56 vars in 1201 bytes} [Sun Oct 23 00:42:45 2022] GET /identity/v3/groups/c5265fb9959c4b70b9b5f282160f6827 => generated 226 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:45.991266 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9876d4c5-1fa0-4a57-bd8f-c8dd03779eb3 admin admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:45.992937 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-a66c2f55-c65a-4d07-b112-6b21caff2e93 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:45.994163 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-a66c2f55-c65a-4d07-b112-6b21caff2e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:46.005865 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9876d4c5-1fa0-4a57-bd8f-c8dd03779eb3 admin admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:46.018794 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 137/262] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 23 00:42:46.021423 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d375ea6-af1c-440f-a83e-c6fce50c69b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:46.022098 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d375ea6-af1c-440f-a83e-c6fce50c69b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:46.022380 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d375ea6-af1c-440f-a83e-c6fce50c69b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:46.022655 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d375ea6-af1c-440f-a83e-c6fce50c69b3 admin admin] PATH_INFO: `/v3/projects/31a760413eac4b69bea4dd231b89ba6e` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:46.023806 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d375ea6-af1c-440f-a83e-c6fce50c69b3 admin admin] RBAC: Authorizing `identity:get_project(project_id=31a760413eac4b69bea4dd231b89ba6e)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:46.025923 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d375ea6-af1c-440f-a83e-c6fce50c69b3 admin admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:46.027593 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 126/263] 10.222.0.23 () {56 vars in 1207 bytes} [Sun Oct 23 00:42:45 2022] GET /identity/v3/projects/31a760413eac4b69bea4dd231b89ba6e => generated 298 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:46.033607 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c2f55-c65a-4d07-b112-6b21caff2e93 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:46.047309 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c2f55-c65a-4d07-b112-6b21caff2e93 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:46.051899 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d2272-8190-4a81-a13d-767c6d2f543f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:46.052569 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d2272-8190-4a81-a13d-767c6d2f543f admin admin] REQUEST_METHOD: `PUT` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:46.052848 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d2272-8190-4a81-a13d-767c6d2f543f admin admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:46.053122 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d2272-8190-4a81-a13d-767c6d2f543f admin admin] PATH_INFO: `/v3/projects/31a760413eac4b69bea4dd231b89ba6e/groups/c5265fb9959c4b70b9b5f282160f6827/roles/130c11043623491c8f8e67ecb6f3efbc` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:46.055050 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d2272-8190-4a81-a13d-767c6d2f543f admin admin] RBAC: Authorizing `identity:create_grant(project_id=31a760413eac4b69bea4dd231b89ba6e, group_id=c5265fb9959c4b70b9b5f282160f6827, role_id=130c11043623491c8f8e67ecb6f3efbc)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:46.056166 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: WARNING py.warnings [None req-072d2272-8190-4a81-a13d-767c6d2f543f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 00:42:46.056166 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: warnings.warn(msg) Oct 23 00:42:46.056166 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: Oct 23 00:42:46.058149 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d2272-8190-4a81-a13d-767c6d2f543f admin admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:46.096900 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 138/264] 10.222.0.23 () {58 vars in 1463 bytes} [Sun Oct 23 00:42:46 2022] PUT /identity/v3/projects/31a760413eac4b69bea4dd231b89ba6e/groups/c5265fb9959c4b70b9b5f282160f6827/roles/130c11043623491c8f8e67ecb6f3efbc => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:42:46.113719 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f0dfc-4a2e-4e73-8f64-0841643c037d None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:46.114573 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f0dfc-4a2e-4e73-8f64-0841643c037d None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:46.114833 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f0dfc-4a2e-4e73-8f64-0841643c037d None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:46.116599 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 127/265] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:42:46.122355 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0f37d-1f28-499d-856c-82c83fdf1e7e None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:46.122641 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0f37d-1f28-499d-856c-82c83fdf1e7e None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:46.122921 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0f37d-1f28-499d-856c-82c83fdf1e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:46.148186 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-d5a0f37d-1f28-499d-856c-82c83fdf1e7e None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:46.149404 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-d5a0f37d-1f28-499d-856c-82c83fdf1e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:46.225026 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 139/266] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 23 00:42:46.536424 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f0dfc-4a2e-4e73-8f64-0841643c037d None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:46.553095 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f0dfc-4a2e-4e73-8f64-0841643c037d None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:46.559505 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ed53b-1fb1-435f-a55c-5a4427e7e09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:46.560138 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ed53b-1fb1-435f-a55c-5a4427e7e09a admin admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:46.560421 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ed53b-1fb1-435f-a55c-5a4427e7e09a admin admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:46.560697 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ed53b-1fb1-435f-a55c-5a4427e7e09a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:46.571631 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:46.574858 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ed53b-1fb1-435f-a55c-5a4427e7e09a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:42:46.580639 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-ee3ed53b-1fb1-435f-a55c-5a4427e7e09a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 00:42:46.580639 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:42:46.580639 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:42:46.580639 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:42:46.580639 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:42:46.580639 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:42:46.580639 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:42:46.580639 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:42:46.580639 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:42:46.580639 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:42:46.580639 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:42:46.580639 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:42:46.580639 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:42:46.580639 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:42:46.580639 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:42:46.580639 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:42:46.581523 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:42:46.581523 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:42:46.581523 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:42:46.581523 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:42:46.581523 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:42:46.581523 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:42:46.581523 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:42:46.581523 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:42:46.581523 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:42:46.581523 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:42:46.581523 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:42:46.581523 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:42:46.581523 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:42:46.581523 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:42:46.581523 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:42:46.581523 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:42:46.582404 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:42:46.582404 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:42:46.582404 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:42:46.582404 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:42:46.582404 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:42:46.582404 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:42:46.582404 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:42:46.582404 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:42:46.582404 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:42:46.582404 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:42:46.582404 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 00:42:46.582404 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:42:46.582404 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 128/267] 10.222.0.23 () {56 vars in 1135 bytes} [Sun Oct 23 00:42:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:42:46.587360 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a0f37d-1f28-499d-856c-82c83fdf1e7e None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:46.589918 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ed53b-1fb1-435f-a55c-5a4427e7e09a admin admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:46.600600 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a0f37d-1f28-499d-856c-82c83fdf1e7e None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:46.601067 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ed53b-1fb1-435f-a55c-5a4427e7e09a admin admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:46.609474 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76abdd4-c63f-459a-b5e1-1410ee8f8bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:46.614096 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76abdd4-c63f-459a-b5e1-1410ee8f8bbf admin admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:46.614096 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76abdd4-c63f-459a-b5e1-1410ee8f8bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:46.614096 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76abdd4-c63f-459a-b5e1-1410ee8f8bbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:46.614096 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76abdd4-c63f-459a-b5e1-1410ee8f8bbf admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:46.614096 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76abdd4-c63f-459a-b5e1-1410ee8f8bbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:46.614460 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: WARNING py.warnings [None req-b76abdd4-c63f-459a-b5e1-1410ee8f8bbf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 00:42:46.614460 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: warnings.warn(msg) Oct 23 00:42:46.614460 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: Oct 23 00:42:46.614460 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76abdd4-c63f-459a-b5e1-1410ee8f8bbf admin admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:46.615775 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f315af-d1ea-42e0-81de-5c16ccce61eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:46.616657 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f315af-d1ea-42e0-81de-5c16ccce61eb admin admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:46.617161 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f315af-d1ea-42e0-81de-5c16ccce61eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:46.617641 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f315af-d1ea-42e0-81de-5c16ccce61eb admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:46.630387 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 129/268] 10.222.0.23 () {56 vars in 1132 bytes} [Sun Oct 23 00:42:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:46.635621 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76abdd4-c63f-459a-b5e1-1410ee8f8bbf admin admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:46.642692 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f315af-d1ea-42e0-81de-5c16ccce61eb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:42:46.649752 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-47f315af-d1ea-42e0-81de-5c16ccce61eb admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:42:46.649752 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:42:46.649752 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:42:46.649752 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:42:46.649752 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:42:46.649752 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:42:46.649752 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:42:46.649752 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:42:46.649752 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:42:46.649752 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:42:46.649752 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:42:46.649752 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:42:46.649752 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:42:46.649752 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:42:46.649752 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:42:46.649752 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:42:46.650685 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:42:46.650685 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:42:46.650685 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:42:46.650685 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:42:46.650685 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:42:46.650685 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:42:46.650685 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:42:46.650685 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:42:46.650685 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:42:46.650685 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:42:46.650685 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:42:46.650685 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:42:46.650685 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:42:46.650685 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:42:46.650685 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:42:46.650685 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:42:46.651465 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:42:46.651465 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:42:46.651465 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:42:46.651465 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:42:46.651465 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:42:46.651465 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:42:46.651465 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:42:46.651465 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:42:46.651465 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:42:46.651465 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:42:46.651465 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:42:46.651465 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:42:46.654194 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 140/269] 10.222.0.23 () {56 vars in 1120 bytes} [Sun Oct 23 00:42:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:42:46.654792 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76abdd4-c63f-459a-b5e1-1410ee8f8bbf admin admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:46.660858 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f315af-d1ea-42e0-81de-5c16ccce61eb admin admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:46.663570 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f411892-1acb-4ba7-b9fb-c0343ad36ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:46.664227 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f411892-1acb-4ba7-b9fb-c0343ad36ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:46.664510 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f411892-1acb-4ba7-b9fb-c0343ad36ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:46.664785 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f411892-1acb-4ba7-b9fb-c0343ad36ad9 admin admin] PATH_INFO: `/v3/groups/c5265fb9959c4b70b9b5f282160f6827` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:46.670838 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f411892-1acb-4ba7-b9fb-c0343ad36ad9 admin admin] RBAC: Authorizing `identity:get_group(group_id=c5265fb9959c4b70b9b5f282160f6827)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:46.672807 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f411892-1acb-4ba7-b9fb-c0343ad36ad9 admin admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:46.674758 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 130/270] 10.222.0.23 () {56 vars in 1201 bytes} [Sun Oct 23 00:42:46 2022] GET /identity/v3/groups/c5265fb9959c4b70b9b5f282160f6827 => generated 226 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:42:46.676930 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f315af-d1ea-42e0-81de-5c16ccce61eb admin admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:46.680243 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f411892-1acb-4ba7-b9fb-c0343ad36ad9 admin admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:46.683268 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e741be1e-1f2b-4fa3-b340-09befa6ce10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:46.684160 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741be1e-1f2b-4fa3-b340-09befa6ce10c admin admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:46.684663 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741be1e-1f2b-4fa3-b340-09befa6ce10c admin admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:46.685141 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741be1e-1f2b-4fa3-b340-09befa6ce10c admin admin] PATH_INFO: `/v3/roles` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:46.686021 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e741be1e-1f2b-4fa3-b340-09befa6ce10c admin admin] RBAC: Adding query filter params (name=member) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:46.686550 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e741be1e-1f2b-4fa3-b340-09befa6ce10c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:46.688404 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e741be1e-1f2b-4fa3-b340-09befa6ce10c admin admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:46.702686 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f411892-1acb-4ba7-b9fb-c0343ad36ad9 admin admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:46.707376 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 141/271] 10.222.0.23 () {56 vars in 1122 bytes} [Sun Oct 23 00:42:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:46.711310 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d1ca3-9998-44a6-9df5-a8d465ef1405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:46.711991 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d1ca3-9998-44a6-9df5-a8d465ef1405 admin admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:46.712270 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d1ca3-9998-44a6-9df5-a8d465ef1405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:46.712622 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d1ca3-9998-44a6-9df5-a8d465ef1405 admin admin] PATH_INFO: `/v3/projects/31a760413eac4b69bea4dd231b89ba6e` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:46.713752 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d1ca3-9998-44a6-9df5-a8d465ef1405 admin admin] RBAC: Authorizing `identity:get_project(project_id=31a760413eac4b69bea4dd231b89ba6e)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:46.715384 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e741be1e-1f2b-4fa3-b340-09befa6ce10c admin admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:46.723266 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d1ca3-9998-44a6-9df5-a8d465ef1405 admin admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:46.726143 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 131/272] 10.222.0.23 () {56 vars in 1207 bytes} [Sun Oct 23 00:42:46 2022] GET /identity/v3/projects/31a760413eac4b69bea4dd231b89ba6e => generated 298 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:42:46.732747 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e741be1e-1f2b-4fa3-b340-09befa6ce10c admin admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:46.736688 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d1ca3-9998-44a6-9df5-a8d465ef1405 admin admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:46.742498 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd21362-9720-4d2f-82ba-87b32307c0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:46.743175 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd21362-9720-4d2f-82ba-87b32307c0b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:46.743457 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd21362-9720-4d2f-82ba-87b32307c0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:46.743728 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd21362-9720-4d2f-82ba-87b32307c0b6 admin admin] PATH_INFO: `/v3/groups/c5265fb9959c4b70b9b5f282160f6827` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:46.747507 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d1ca3-9998-44a6-9df5-a8d465ef1405 admin admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:46.750831 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd21362-9720-4d2f-82ba-87b32307c0b6 admin admin] RBAC: Authorizing `identity:get_group(group_id=c5265fb9959c4b70b9b5f282160f6827)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:46.751883 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: WARNING py.warnings [None req-3dd21362-9720-4d2f-82ba-87b32307c0b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 00:42:46.751883 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: warnings.warn(msg) Oct 23 00:42:46.751883 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: Oct 23 00:42:46.753113 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd21362-9720-4d2f-82ba-87b32307c0b6 admin admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:46.755571 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dca493-d59d-4c62-bba5-aad9ecd3f248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:46.755734 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 142/273] 10.222.0.23 () {56 vars in 1201 bytes} [Sun Oct 23 00:42:46 2022] GET /identity/v3/groups/c5265fb9959c4b70b9b5f282160f6827 => generated 226 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:42:46.756596 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dca493-d59d-4c62-bba5-aad9ecd3f248 admin admin] REQUEST_METHOD: `PUT` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:46.757019 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dca493-d59d-4c62-bba5-aad9ecd3f248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:46.757481 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dca493-d59d-4c62-bba5-aad9ecd3f248 admin admin] PATH_INFO: `/v3/projects/31a760413eac4b69bea4dd231b89ba6e/groups/c5265fb9959c4b70b9b5f282160f6827/roles/9f802c7a3366414c9d0ee9e7a4cb5b74` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:46.760016 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dca493-d59d-4c62-bba5-aad9ecd3f248 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31a760413eac4b69bea4dd231b89ba6e, group_id=c5265fb9959c4b70b9b5f282160f6827, role_id=9f802c7a3366414c9d0ee9e7a4cb5b74)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:46.761270 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: WARNING py.warnings [None req-36dca493-d59d-4c62-bba5-aad9ecd3f248 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 00:42:46.761270 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: warnings.warn(msg) Oct 23 00:42:46.761270 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: Oct 23 00:42:46.762161 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd21362-9720-4d2f-82ba-87b32307c0b6 admin admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:46.763836 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dca493-d59d-4c62-bba5-aad9ecd3f248 admin admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:46.778757 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd21362-9720-4d2f-82ba-87b32307c0b6 admin admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:46.789207 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 132/274] 10.222.0.23 () {58 vars in 1463 bytes} [Sun Oct 23 00:42:46 2022] PUT /identity/v3/projects/31a760413eac4b69bea4dd231b89ba6e/groups/c5265fb9959c4b70b9b5f282160f6827/roles/9f802c7a3366414c9d0ee9e7a4cb5b74 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:42:46.793484 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e32798-f89d-4f3e-bcea-f615486f88b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:46.794390 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e32798-f89d-4f3e-bcea-f615486f88b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:46.794878 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e32798-f89d-4f3e-bcea-f615486f88b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:46.795290 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e32798-f89d-4f3e-bcea-f615486f88b8 admin admin] PATH_INFO: `/v3/projects/c072d440807e45aa8ff63548aa916fc2` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:46.796756 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e32798-f89d-4f3e-bcea-f615486f88b8 admin admin] RBAC: Authorizing `identity:get_project(project_id=c072d440807e45aa8ff63548aa916fc2)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:46.799254 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e32798-f89d-4f3e-bcea-f615486f88b8 admin admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:46.801645 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 143/275] 10.222.0.23 () {56 vars in 1207 bytes} [Sun Oct 23 00:42:46 2022] GET /identity/v3/projects/c072d440807e45aa8ff63548aa916fc2 => generated 302 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:42:46.808425 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dca493-d59d-4c62-bba5-aad9ecd3f248 admin admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:46.883215 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dca493-d59d-4c62-bba5-aad9ecd3f248 admin admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:46.888184 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69623c1-62ec-4680-a5a3-442ae4f2d22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:46.889052 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69623c1-62ec-4680-a5a3-442ae4f2d22d admin admin] REQUEST_METHOD: `PUT` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:46.889521 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69623c1-62ec-4680-a5a3-442ae4f2d22d admin admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:46.889932 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69623c1-62ec-4680-a5a3-442ae4f2d22d admin admin] PATH_INFO: `/v3/projects/c072d440807e45aa8ff63548aa916fc2/groups/c5265fb9959c4b70b9b5f282160f6827/roles/130c11043623491c8f8e67ecb6f3efbc` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:46.891993 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69623c1-62ec-4680-a5a3-442ae4f2d22d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c072d440807e45aa8ff63548aa916fc2, group_id=c5265fb9959c4b70b9b5f282160f6827, role_id=130c11043623491c8f8e67ecb6f3efbc)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:46.895250 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69623c1-62ec-4680-a5a3-442ae4f2d22d admin admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:46.913886 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 133/276] 10.222.0.23 () {58 vars in 1463 bytes} [Sun Oct 23 00:42:46 2022] PUT /identity/v3/projects/c072d440807e45aa8ff63548aa916fc2/groups/c5265fb9959c4b70b9b5f282160f6827/roles/130c11043623491c8f8e67ecb6f3efbc => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:42:47.103221 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381543a-d5f8-4f99-8f08-3249775ad95d None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:47.103740 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381543a-d5f8-4f99-8f08-3249775ad95d None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:47.104159 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381543a-d5f8-4f99-8f08-3249775ad95d None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:47.106601 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 144/277] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:42:47.112812 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec30b18-0c8d-496e-936d-a56598f18676 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:47.113325 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec30b18-0c8d-496e-936d-a56598f18676 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:47.113763 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec30b18-0c8d-496e-936d-a56598f18676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:47.135079 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-eec30b18-0c8d-496e-936d-a56598f18676 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:47.136554 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-eec30b18-0c8d-496e-936d-a56598f18676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:47.212664 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 134/278] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:42:47.506677 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381543a-d5f8-4f99-8f08-3249775ad95d None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:47.534657 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:47.633549 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381543a-d5f8-4f99-8f08-3249775ad95d None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:47.673462 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f12a3-a009-43d4-8ef5-52e83da87d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:47.674103 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f12a3-a009-43d4-8ef5-52e83da87d05 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:47.674421 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f12a3-a009-43d4-8ef5-52e83da87d05 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:47.674691 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f12a3-a009-43d4-8ef5-52e83da87d05 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:47.686836 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7f12a3-a009-43d4-8ef5-52e83da87d05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:42:47.696312 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-8f7f12a3-a009-43d4-8ef5-52e83da87d05 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 00:42:47.696312 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:42:47.696312 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:42:47.696312 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:42:47.696312 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:42:47.696312 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:42:47.696312 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:42:47.696312 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:42:47.696312 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:42:47.696312 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:42:47.696312 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:42:47.696312 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:42:47.696312 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:42:47.696312 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:42:47.696312 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:42:47.696312 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:42:47.697201 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:42:47.697201 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:42:47.697201 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:42:47.697201 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:42:47.697201 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:42:47.697201 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:42:47.697201 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:42:47.697201 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:42:47.697201 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:42:47.697201 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:42:47.697201 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:42:47.697201 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:42:47.697201 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:42:47.697201 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:42:47.697201 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:42:47.697201 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:42:47.697973 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:42:47.697973 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:42:47.697973 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:42:47.697973 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:42:47.697973 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:42:47.697973 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:42:47.697973 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:42:47.697973 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:42:47.697973 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:42:47.697973 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:42:47.697973 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 23 00:42:47.697973 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:42:47.697973 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 145/279] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 23 00:42:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:42:47.703694 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec30b18-0c8d-496e-936d-a56598f18676 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:47.752498 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:47.776821 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2cc99-7373-4cf5-ac84-2957e27fba94 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:47.777372 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2cc99-7373-4cf5-ac84-2957e27fba94 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:47.777991 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2cc99-7373-4cf5-ac84-2957e27fba94 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:47.779587 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 146/280] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:42:47.785701 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72e147-b687-4625-ba90-3f509a7d0140 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:47.786286 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72e147-b687-4625-ba90-3f509a7d0140 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:47.786808 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72e147-b687-4625-ba90-3f509a7d0140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:47.819215 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-7d72e147-b687-4625-ba90-3f509a7d0140 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:47.820731 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-7d72e147-b687-4625-ba90-3f509a7d0140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:47.821271 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec30b18-0c8d-496e-936d-a56598f18676 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:47.860520 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff00f5-3b98-4ee2-87d5-751e68283b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:47.861146 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff00f5-3b98-4ee2-87d5-751e68283b0f None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:47.861426 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff00f5-3b98-4ee2-87d5-751e68283b0f None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:47.861693 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff00f5-3b98-4ee2-87d5-751e68283b0f None admin] PATH_INFO: `/v3/roles` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:47.862412 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff00f5-3b98-4ee2-87d5-751e68283b0f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:47.862706 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff00f5-3b98-4ee2-87d5-751e68283b0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:47.864792 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff00f5-3b98-4ee2-87d5-751e68283b0f None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:47.874771 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 135/281] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 23 00:42:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:47.881162 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff00f5-3b98-4ee2-87d5-751e68283b0f None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:47.935773 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 147/282] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:47 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 23 00:42:47.997922 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d34c2-ea8f-4be8-8170-51a5996aac7c None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:47.998482 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d34c2-ea8f-4be8-8170-51a5996aac7c None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:47.998979 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d34c2-ea8f-4be8-8170-51a5996aac7c None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:48.000996 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 148/283] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:42:48.003783 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff00f5-3b98-4ee2-87d5-751e68283b0f None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:48.006234 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:48.007969 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c78208-6d60-4341-9253-882087683dd2 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:48.008560 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c78208-6d60-4341-9253-882087683dd2 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:48.009036 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c78208-6d60-4341-9253-882087683dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:48.042887 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-70c78208-6d60-4341-9253-882087683dd2 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:48.044455 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-70c78208-6d60-4341-9253-882087683dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:48.056058 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 149/284] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 23 00:42:48.069732 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e27088-75a4-4300-b595-5f3192b545aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:48.070439 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e27088-75a4-4300-b595-5f3192b545aa None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:48.070709 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e27088-75a4-4300-b595-5f3192b545aa None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:48.070977 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e27088-75a4-4300-b595-5f3192b545aa None admin] PATH_INFO: `/v3/users/d833a85b42894ac596a88150d9a9e52c` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:48.072197 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e27088-75a4-4300-b595-5f3192b545aa None admin] RBAC: Authorizing `identity:get_user(user_id=d833a85b42894ac596a88150d9a9e52c)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:48.073800 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e27088-75a4-4300-b595-5f3192b545aa None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:48.075726 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 136/285] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 23 00:42:47 2022] GET /identity/v3/users/d833a85b42894ac596a88150d9a9e52c => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:42:48.081616 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c78208-6d60-4341-9253-882087683dd2 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:48.113677 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:48.201603 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c78208-6d60-4341-9253-882087683dd2 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:48.250100 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d852a1-59fd-47be-ace7-8bf611f854e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:48.250100 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d852a1-59fd-47be-ace7-8bf611f854e0 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:48.250100 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d852a1-59fd-47be-ace7-8bf611f854e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:48.250100 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d852a1-59fd-47be-ace7-8bf611f854e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:48.250528 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d852a1-59fd-47be-ace7-8bf611f854e0 None admin] RBAC: Adding query filter params (role.id=7ccf4c0abd6b4bf58ad8cca0e05c25a4, user.id=d833a85b42894ac596a88150d9a9e52c, scope.system=all) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:48.250528 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d852a1-59fd-47be-ace7-8bf611f854e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:48.251343 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d852a1-59fd-47be-ace7-8bf611f854e0 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:48.271551 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 150/286] 10.222.0.23 () {56 vars in 1308 bytes} [Sun Oct 23 00:42:48 2022] GET /identity/v3/role_assignments?user.id=d833a85b42894ac596a88150d9a9e52c&scope.system=all&role.id=7ccf4c0abd6b4bf58ad8cca0e05c25a4 => generated 510 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:48.356174 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e27088-75a4-4300-b595-5f3192b545aa None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:48.368002 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e27088-75a4-4300-b595-5f3192b545aa None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:48.372755 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf9d35-e0fe-47ae-aef5-3a475e85a812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:48.373629 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf9d35-e0fe-47ae-aef5-3a475e85a812 admin admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:48.374147 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf9d35-e0fe-47ae-aef5-3a475e85a812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:48.374665 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf9d35-e0fe-47ae-aef5-3a475e85a812 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:48.392680 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf9d35-e0fe-47ae-aef5-3a475e85a812 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:42:48.398719 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-e9bf9d35-e0fe-47ae-aef5-3a475e85a812 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 00:42:48.398719 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:42:48.398719 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:42:48.398719 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:42:48.398719 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:42:48.398719 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:42:48.398719 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:42:48.398719 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:42:48.398719 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:42:48.398719 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:42:48.398719 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:42:48.398719 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:42:48.398719 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:42:48.398719 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:42:48.398719 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:42:48.398719 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:42:48.399690 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:42:48.399690 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:42:48.399690 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:42:48.399690 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:42:48.399690 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:42:48.399690 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:42:48.399690 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:42:48.399690 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:42:48.399690 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:42:48.399690 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:42:48.399690 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:42:48.399690 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:42:48.399690 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:42:48.399690 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:42:48.399690 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:42:48.399690 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:42:48.400504 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:42:48.400504 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:42:48.400504 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:42:48.400504 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:42:48.400504 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:42:48.400504 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:42:48.400504 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:42:48.400504 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:42:48.400504 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:42:48.400504 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:42:48.400504 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 00:42:48.400504 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:42:48.402978 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 137/287] 10.222.0.23 () {56 vars in 1135 bytes} [Sun Oct 23 00:42:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:42:48.409082 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d852a1-59fd-47be-ace7-8bf611f854e0 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:48.423197 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d852a1-59fd-47be-ace7-8bf611f854e0 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:48.431068 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5289e9-6523-4a2a-b210-c43ddc3df097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:48.431752 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5289e9-6523-4a2a-b210-c43ddc3df097 admin admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:48.432091 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5289e9-6523-4a2a-b210-c43ddc3df097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:48.432366 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5289e9-6523-4a2a-b210-c43ddc3df097 admin admin] PATH_INFO: `/v3/roles` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:48.433064 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5289e9-6523-4a2a-b210-c43ddc3df097 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:48.433371 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5289e9-6523-4a2a-b210-c43ddc3df097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:48.436382 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5289e9-6523-4a2a-b210-c43ddc3df097 admin admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:48.448376 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 151/288] 10.222.0.23 () {56 vars in 1132 bytes} [Sun Oct 23 00:42:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:48.454290 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf9d35-e0fe-47ae-aef5-3a475e85a812 admin admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:48.467419 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf9d35-e0fe-47ae-aef5-3a475e85a812 admin admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:48.478296 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd5c10-06e5-43ba-929d-1b2e45608476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:48.479279 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd5c10-06e5-43ba-929d-1b2e45608476 admin admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:48.479779 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd5c10-06e5-43ba-929d-1b2e45608476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:48.480535 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd5c10-06e5-43ba-929d-1b2e45608476 admin admin] PATH_INFO: `/v3/groups/c5265fb9959c4b70b9b5f282160f6827` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:48.482733 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dd5c10-06e5-43ba-929d-1b2e45608476 admin admin] RBAC: Authorizing `identity:get_group(group_id=c5265fb9959c4b70b9b5f282160f6827)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:48.484909 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dd5c10-06e5-43ba-929d-1b2e45608476 admin admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:48.487212 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 138/289] 10.222.0.23 () {56 vars in 1201 bytes} [Sun Oct 23 00:42:48 2022] GET /identity/v3/groups/c5265fb9959c4b70b9b5f282160f6827 => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:48.493649 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5289e9-6523-4a2a-b210-c43ddc3df097 admin admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:48.509100 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5289e9-6523-4a2a-b210-c43ddc3df097 admin admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:48.513921 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dbe487-e269-4c48-b2fe-48fa9ab7b0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:48.514666 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dbe487-e269-4c48-b2fe-48fa9ab7b0fa admin admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:48.514949 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dbe487-e269-4c48-b2fe-48fa9ab7b0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:48.515226 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dbe487-e269-4c48-b2fe-48fa9ab7b0fa admin admin] PATH_INFO: `/v3/projects/c072d440807e45aa8ff63548aa916fc2` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:48.516569 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dbe487-e269-4c48-b2fe-48fa9ab7b0fa admin admin] RBAC: Authorizing `identity:get_project(project_id=c072d440807e45aa8ff63548aa916fc2)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:48.518778 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dbe487-e269-4c48-b2fe-48fa9ab7b0fa admin admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:48.520685 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 152/290] 10.222.0.23 () {56 vars in 1207 bytes} [Sun Oct 23 00:42:48 2022] GET /identity/v3/projects/c072d440807e45aa8ff63548aa916fc2 => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:48.526641 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd5c10-06e5-43ba-929d-1b2e45608476 admin admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:48.544035 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd5c10-06e5-43ba-929d-1b2e45608476 admin admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:48.554970 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5004abdf-8cd3-4394-8e9a-31b7050d5585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:48.556025 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004abdf-8cd3-4394-8e9a-31b7050d5585 admin admin] REQUEST_METHOD: `PUT` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:48.556509 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004abdf-8cd3-4394-8e9a-31b7050d5585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:48.556980 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004abdf-8cd3-4394-8e9a-31b7050d5585 admin admin] PATH_INFO: `/v3/projects/c072d440807e45aa8ff63548aa916fc2/groups/c5265fb9959c4b70b9b5f282160f6827/roles/9f802c7a3366414c9d0ee9e7a4cb5b74` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:48.564274 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5004abdf-8cd3-4394-8e9a-31b7050d5585 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c072d440807e45aa8ff63548aa916fc2, group_id=c5265fb9959c4b70b9b5f282160f6827, role_id=9f802c7a3366414c9d0ee9e7a4cb5b74)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:48.567923 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5004abdf-8cd3-4394-8e9a-31b7050d5585 admin admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:48.599438 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 139/291] 10.222.0.23 () {58 vars in 1463 bytes} [Sun Oct 23 00:42:48 2022] PUT /identity/v3/projects/c072d440807e45aa8ff63548aa916fc2/groups/c5265fb9959c4b70b9b5f282160f6827/roles/9f802c7a3366414c9d0ee9e7a4cb5b74 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:42:48.635484 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dbe487-e269-4c48-b2fe-48fa9ab7b0fa admin admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:48.647933 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dbe487-e269-4c48-b2fe-48fa9ab7b0fa admin admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:48.716976 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518f9d9-5cad-42ad-9851-7046b9f6cc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:48.717667 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518f9d9-5cad-42ad-9851-7046b9f6cc6d admin admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:48.717951 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518f9d9-5cad-42ad-9851-7046b9f6cc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:48.718283 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518f9d9-5cad-42ad-9851-7046b9f6cc6d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:48.735716 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0518f9d9-5cad-42ad-9851-7046b9f6cc6d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:42:48.740997 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-0518f9d9-5cad-42ad-9851-7046b9f6cc6d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:42:48.740997 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:42:48.740997 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:42:48.740997 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:42:48.740997 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:42:48.740997 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:42:48.740997 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:42:48.740997 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:42:48.740997 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:42:48.740997 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:42:48.740997 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:42:48.740997 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:42:48.740997 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:42:48.740997 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:42:48.740997 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:42:48.740997 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:42:48.741900 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:42:48.741900 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:42:48.741900 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:42:48.741900 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:42:48.741900 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:42:48.741900 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:42:48.741900 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:42:48.741900 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:42:48.741900 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:42:48.741900 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:42:48.741900 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:42:48.741900 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:42:48.741900 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:42:48.741900 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:42:48.741900 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:42:48.741900 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:42:48.742722 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:42:48.742722 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:42:48.742722 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:42:48.742722 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:42:48.742722 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:42:48.742722 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:42:48.742722 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:42:48.742722 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:42:48.742722 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:42:48.742722 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:42:48.742722 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:42:48.742722 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:42:48.742722 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 153/292] 10.222.0.23 () {56 vars in 1117 bytes} [Sun Oct 23 00:42:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 107 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:42:48.749485 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5004abdf-8cd3-4394-8e9a-31b7050d5585 admin admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:48.767806 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5004abdf-8cd3-4394-8e9a-31b7050d5585 admin admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:48.778535 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a938e1-5e46-4724-887a-a8cfce566c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:48.779540 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a938e1-5e46-4724-887a-a8cfce566c47 admin admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:48.780022 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a938e1-5e46-4724-887a-a8cfce566c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:48.780491 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a938e1-5e46-4724-887a-a8cfce566c47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:48.781371 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a938e1-5e46-4724-887a-a8cfce566c47 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:48.781906 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a938e1-5e46-4724-887a-a8cfce566c47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:48.783805 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a938e1-5e46-4724-887a-a8cfce566c47 admin admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:48.799357 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 140/293] 10.222.0.23 () {56 vars in 1120 bytes} [Sun Oct 23 00:42:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:48.805579 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518f9d9-5cad-42ad-9851-7046b9f6cc6d admin admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:48.820086 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518f9d9-5cad-42ad-9851-7046b9f6cc6d admin admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:48.824589 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b77b0-e36c-4ca3-bab5-b4e20df64ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:48.825229 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b77b0-e36c-4ca3-bab5-b4e20df64ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:48.825511 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b77b0-e36c-4ca3-bab5-b4e20df64ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:48.825850 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b77b0-e36c-4ca3-bab5-b4e20df64ba4 admin admin] PATH_INFO: `/v3/groups/d3659ac9c6244e85b1054122e78db820` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:48.828090 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:48.838667 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b77b0-e36c-4ca3-bab5-b4e20df64ba4 admin admin] RBAC: Authorizing `identity:get_group(group_id=d3659ac9c6244e85b1054122e78db820)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:48.840776 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b77b0-e36c-4ca3-bab5-b4e20df64ba4 admin admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:48.845974 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 154/294] 10.222.0.23 () {56 vars in 1201 bytes} [Sun Oct 23 00:42:48 2022] GET /identity/v3/groups/d3659ac9c6244e85b1054122e78db820 => generated 229 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:48.848671 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a938e1-5e46-4724-887a-a8cfce566c47 admin admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:48.863642 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a938e1-5e46-4724-887a-a8cfce566c47 admin admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:48.870234 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af1c44-f366-4fea-a1c0-2d86c41b28a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:48.871188 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af1c44-f366-4fea-a1c0-2d86c41b28a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:48.871671 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af1c44-f366-4fea-a1c0-2d86c41b28a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:48.872142 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af1c44-f366-4fea-a1c0-2d86c41b28a4 admin admin] PATH_INFO: `/v3/projects/1e595cb6a4664ac2825c0ea6a16cb095` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:48.879030 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af1c44-f366-4fea-a1c0-2d86c41b28a4 admin admin] RBAC: Authorizing `identity:get_project(project_id=1e595cb6a4664ac2825c0ea6a16cb095)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:48.881862 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af1c44-f366-4fea-a1c0-2d86c41b28a4 admin admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:48.883962 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 141/295] 10.222.0.23 () {56 vars in 1207 bytes} [Sun Oct 23 00:42:48 2022] GET /identity/v3/projects/1e595cb6a4664ac2825c0ea6a16cb095 => generated 344 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:48.889987 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b77b0-e36c-4ca3-bab5-b4e20df64ba4 admin admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:48.904694 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b77b0-e36c-4ca3-bab5-b4e20df64ba4 admin admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:48.909471 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e3ea01-cb37-4f71-a4af-2c5d28efd150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:48.910174 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3ea01-cb37-4f71-a4af-2c5d28efd150 admin admin] REQUEST_METHOD: `PUT` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:48.910462 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3ea01-cb37-4f71-a4af-2c5d28efd150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:48.910767 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3ea01-cb37-4f71-a4af-2c5d28efd150 admin admin] PATH_INFO: `/v3/projects/1e595cb6a4664ac2825c0ea6a16cb095/groups/d3659ac9c6244e85b1054122e78db820/roles/1e2073be75174689aa4fac29e674583d` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:48.912749 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e3ea01-cb37-4f71-a4af-2c5d28efd150 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e595cb6a4664ac2825c0ea6a16cb095, group_id=d3659ac9c6244e85b1054122e78db820, role_id=1e2073be75174689aa4fac29e674583d)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:48.919730 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e3ea01-cb37-4f71-a4af-2c5d28efd150 admin admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:48.954145 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 155/296] 10.222.0.23 () {58 vars in 1463 bytes} [Sun Oct 23 00:42:48 2022] PUT /identity/v3/projects/1e595cb6a4664ac2825c0ea6a16cb095/groups/d3659ac9c6244e85b1054122e78db820/roles/1e2073be75174689aa4fac29e674583d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:42:49.966412 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5c25b-5a05-4c22-91a7-d8fd3f16d023 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:49.966942 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5c25b-5a05-4c22-91a7-d8fd3f16d023 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:49.966942 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5c25b-5a05-4c22-91a7-d8fd3f16d023 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:49.968335 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 142/297] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:42:49.974481 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c64f9-ad5b-4949-94a8-db436a50ff51 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:49.974986 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c64f9-ad5b-4949-94a8-db436a50ff51 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:49.975059 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c64f9-ad5b-4949-94a8-db436a50ff51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:49.999073 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-d98c64f9-ad5b-4949-94a8-db436a50ff51 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:50.000276 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-d98c64f9-ad5b-4949-94a8-db436a50ff51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:50.089846 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 156/298] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:42:50.092067 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb8526-ebfc-4c32-8413-7c0c7de5e7a7 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:50.092347 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb8526-ebfc-4c32-8413-7c0c7de5e7a7 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:50.092616 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb8526-ebfc-4c32-8413-7c0c7de5e7a7 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:50.093940 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 143/299] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:42:50.099212 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39789eb-913f-40b9-9b8c-52b3645a9051 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:50.099502 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39789eb-913f-40b9-9b8c-52b3645a9051 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:50.099780 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39789eb-913f-40b9-9b8c-52b3645a9051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:50.118655 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-e39789eb-913f-40b9-9b8c-52b3645a9051 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:50.119832 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-e39789eb-913f-40b9-9b8c-52b3645a9051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:50.203538 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 157/300] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:42:50.452921 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb8526-ebfc-4c32-8413-7c0c7de5e7a7 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:50.512750 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089d995-93ba-4d41-b291-0305a443fdb5 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:50.513037 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089d995-93ba-4d41-b291-0305a443fdb5 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:50.513213 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089d995-93ba-4d41-b291-0305a443fdb5 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:50.514602 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 158/301] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:42:50.519798 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46d309-ea84-4e6d-9ad8-03cde5f54c2d None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:50.520079 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46d309-ea84-4e6d-9ad8-03cde5f54c2d None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:50.520382 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46d309-ea84-4e6d-9ad8-03cde5f54c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:50.553304 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-5c46d309-ea84-4e6d-9ad8-03cde5f54c2d None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:50.556349 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-5c46d309-ea84-4e6d-9ad8-03cde5f54c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:50.611805 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb8526-ebfc-4c32-8413-7c0c7de5e7a7 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:50.630405 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:50.642505 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:50.652012 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de3106-12ae-4448-809c-f614fd326134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:50.653416 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de3106-12ae-4448-809c-f614fd326134 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:50.654064 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de3106-12ae-4448-809c-f614fd326134 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:50.654739 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de3106-12ae-4448-809c-f614fd326134 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:50.667887 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04de3106-12ae-4448-809c-f614fd326134 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:42:50.669329 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 159/302] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:42:50.670321 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46d309-ea84-4e6d-9ad8-03cde5f54c2d None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:50.678978 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-04de3106-12ae-4448-809c-f614fd326134 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:42:50.678978 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:42:50.678978 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:42:50.678978 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:42:50.678978 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:42:50.678978 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:42:50.678978 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:42:50.678978 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:42:50.678978 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:42:50.678978 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:42:50.678978 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:42:50.678978 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:42:50.678978 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:42:50.678978 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:42:50.678978 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:42:50.678978 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:42:50.679886 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:42:50.679886 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:42:50.679886 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:42:50.679886 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:42:50.679886 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:42:50.679886 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:42:50.679886 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:42:50.679886 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:42:50.679886 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:42:50.679886 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:42:50.679886 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:42:50.679886 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:42:50.679886 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:42:50.679886 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:42:50.679886 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:42:50.679886 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:42:50.680684 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:42:50.680684 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:42:50.680684 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:42:50.680684 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:42:50.680684 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:42:50.680684 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:42:50.680684 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:42:50.680684 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:42:50.680684 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:42:50.680684 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:42:50.680684 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:42:50.680684 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:42:50.680684 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 144/303] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 23 00:42:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:42:50.685954 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de3106-12ae-4448-809c-f614fd326134 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:50.869289 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46d309-ea84-4e6d-9ad8-03cde5f54c2d None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:50.874228 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de3106-12ae-4448-809c-f614fd326134 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:50.915806 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3b6ad-fe05-4714-bdd7-563081d867b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:50.916428 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3b6ad-fe05-4714-bdd7-563081d867b6 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:50.916702 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3b6ad-fe05-4714-bdd7-563081d867b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:50.916995 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3b6ad-fe05-4714-bdd7-563081d867b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:50.917818 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3b6ad-fe05-4714-bdd7-563081d867b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:50.918154 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3b6ad-fe05-4714-bdd7-563081d867b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:50.919710 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3b6ad-fe05-4714-bdd7-563081d867b6 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:50.920539 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6e813-1f58-4149-b1cd-f826d8581675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:50.921413 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6e813-1f58-4149-b1cd-f826d8581675 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:50.921891 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6e813-1f58-4149-b1cd-f826d8581675 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:50.922420 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6e813-1f58-4149-b1cd-f826d8581675 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:50.930488 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 145/304] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 23 00:42:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:50.936022 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3b6ad-fe05-4714-bdd7-563081d867b6 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:50.940359 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6e813-1f58-4149-b1cd-f826d8581675 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:42:50.946126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-f1f6e813-1f58-4149-b1cd-f826d8581675 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:42:50.946126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:42:50.946126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:42:50.946126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:42:50.946126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:42:50.946126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:42:50.946126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:42:50.946126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:42:50.946126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:42:50.946126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:42:50.946126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:42:50.946126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:42:50.946126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:42:50.946126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:42:50.946126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:42:50.946126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:42:50.947040 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:42:50.947040 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:42:50.947040 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:42:50.947040 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:42:50.947040 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:42:50.947040 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:42:50.947040 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:42:50.947040 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:42:50.947040 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:42:50.947040 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:42:50.947040 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:42:50.947040 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:42:50.947040 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:42:50.947040 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:42:50.947040 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:42:50.947040 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:42:50.947920 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:42:50.947920 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:42:50.947920 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:42:50.947920 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:42:50.947920 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:42:50.947920 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:42:50.947920 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:42:50.947920 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:42:50.947920 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:42:50.947920 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:42:50.947920 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 23 00:42:50.947920 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:42:50.949784 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 160/305] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 23 00:42:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:42:50.959096 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6e813-1f58-4149-b1cd-f826d8581675 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:50.997711 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:51.042058 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:51.072819 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3b6ad-fe05-4714-bdd7-563081d867b6 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:51.115230 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34cf377-9439-49db-98cc-6db49c96d093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:51.115841 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cf377-9439-49db-98cc-6db49c96d093 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:51.116381 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cf377-9439-49db-98cc-6db49c96d093 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:51.116660 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cf377-9439-49db-98cc-6db49c96d093 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:51.126824 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6e813-1f58-4149-b1cd-f826d8581675 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:51.178002 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ea88f-147d-4c1d-9463-fa4f8b7b6820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:51.178642 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ea88f-147d-4c1d-9463-fa4f8b7b6820 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:51.178924 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ea88f-147d-4c1d-9463-fa4f8b7b6820 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:51.179202 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ea88f-147d-4c1d-9463-fa4f8b7b6820 None admin] PATH_INFO: `/v3/roles` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:51.179928 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2ea88f-147d-4c1d-9463-fa4f8b7b6820 None admin] RBAC: Adding query filter params (name=member) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:51.180706 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2ea88f-147d-4c1d-9463-fa4f8b7b6820 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:51.182410 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2ea88f-147d-4c1d-9463-fa4f8b7b6820 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:51.194191 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 161/306] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 23 00:42:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:51.195065 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ea88f-147d-4c1d-9463-fa4f8b7b6820 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:51.202814 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34cf377-9439-49db-98cc-6db49c96d093 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:51.206152 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34cf377-9439-49db-98cc-6db49c96d093 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:51.299990 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:51.346442 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:51.352981 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ea88f-147d-4c1d-9463-fa4f8b7b6820 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:51.390588 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 146/307] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 23 00:42:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 23 00:42:51.391551 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34cf377-9439-49db-98cc-6db49c96d093 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:51.405296 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6243d8b2-f128-405f-9928-8c1ee1515def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:51.405938 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243d8b2-f128-405f-9928-8c1ee1515def None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:51.406251 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243d8b2-f128-405f-9928-8c1ee1515def None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:51.406526 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243d8b2-f128-405f-9928-8c1ee1515def None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:51.424993 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6243d8b2-f128-405f-9928-8c1ee1515def None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:42:51.433089 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-6243d8b2-f128-405f-9928-8c1ee1515def None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 00:42:51.433089 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:42:51.433089 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:42:51.433089 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:42:51.433089 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:42:51.433089 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:42:51.433089 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:42:51.433089 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:42:51.433089 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:42:51.433089 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:42:51.433089 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:42:51.433089 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:42:51.433089 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:42:51.433089 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:42:51.433089 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:42:51.433089 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:42:51.434008 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:42:51.434008 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:42:51.434008 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:42:51.434008 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:42:51.434008 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:42:51.434008 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:42:51.434008 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:42:51.434008 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:42:51.434008 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:42:51.434008 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:42:51.434008 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:42:51.434008 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:42:51.434008 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:42:51.434008 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:42:51.434008 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:42:51.434008 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:42:51.434919 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:42:51.434919 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:42:51.434919 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:42:51.434919 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:42:51.434919 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:42:51.434919 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:42:51.434919 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:42:51.434919 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:42:51.434919 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:42:51.434919 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:42:51.434919 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 00:42:51.434919 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:42:51.435518 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 162/308] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 23 00:42:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:42:51.436463 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6243d8b2-f128-405f-9928-8c1ee1515def None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:51.542792 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34cf377-9439-49db-98cc-6db49c96d093 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:51.566656 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6243d8b2-f128-405f-9928-8c1ee1515def None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:51.596083 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac80ad5-56d0-4e89-afc1-4bf2d2bca1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:51.597263 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac80ad5-56d0-4e89-afc1-4bf2d2bca1ea None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:51.597547 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac80ad5-56d0-4e89-afc1-4bf2d2bca1ea None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:51.597820 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac80ad5-56d0-4e89-afc1-4bf2d2bca1ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:51.608697 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffdd09a-d329-4646-89e0-515144add2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:51.609636 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffdd09a-d329-4646-89e0-515144add2cf None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:51.610123 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffdd09a-d329-4646-89e0-515144add2cf None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:51.610577 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffdd09a-d329-4646-89e0-515144add2cf None admin] PATH_INFO: `/v3/projects/c072d440807e45aa8ff63548aa916fc2` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:51.612057 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffdd09a-d329-4646-89e0-515144add2cf None admin] RBAC: Authorizing `identity:get_project(project_id=c072d440807e45aa8ff63548aa916fc2)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:51.613891 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffdd09a-d329-4646-89e0-515144add2cf None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:51.615923 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 163/309] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 23 00:42:51 2022] GET /identity/v3/projects/c072d440807e45aa8ff63548aa916fc2 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:51.616934 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffdd09a-d329-4646-89e0-515144add2cf None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:51.630152 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:51.653767 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:51.699501 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac80ad5-56d0-4e89-afc1-4bf2d2bca1ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:51.700978 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac80ad5-56d0-4e89-afc1-4bf2d2bca1ea None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:51.745696 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffdd09a-d329-4646-89e0-515144add2cf None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:51.792112 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70d9fa-1029-4746-8ace-acdf63eb2e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:51.792741 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70d9fa-1029-4746-8ace-acdf63eb2e9c None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:51.793019 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70d9fa-1029-4746-8ace-acdf63eb2e9c None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:51.793367 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70d9fa-1029-4746-8ace-acdf63eb2e9c None admin] PATH_INFO: `/v3/roles` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:51.794490 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b70d9fa-1029-4746-8ace-acdf63eb2e9c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:51.794490 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b70d9fa-1029-4746-8ace-acdf63eb2e9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:51.795657 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b70d9fa-1029-4746-8ace-acdf63eb2e9c None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:51.809393 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 164/310] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 23 00:42:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:51.809393 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9366a2-a31a-4494-bee6-d549e5a8152b None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:51.809393 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9366a2-a31a-4494-bee6-d549e5a8152b None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:51.809393 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9366a2-a31a-4494-bee6-d549e5a8152b None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:51.809393 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 165/311] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:42:51.809953 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9366a2-a31a-4494-bee6-d549e5a8152b None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:51.845573 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 147/312] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 23 00:42:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 00:42:51.846856 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac80ad5-56d0-4e89-afc1-4bf2d2bca1ea None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:51.910922 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:51.929106 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:51.947672 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9366a2-a31a-4494-bee6-d549e5a8152b None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:51.974179 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac80ad5-56d0-4e89-afc1-4bf2d2bca1ea None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:51.985452 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9d919-c48b-4dc3-8b54-f144842c1aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:51.986132 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9d919-c48b-4dc3-8b54-f144842c1aa2 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:51.986401 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9d919-c48b-4dc3-8b54-f144842c1aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:51.986676 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9d919-c48b-4dc3-8b54-f144842c1aa2 None admin] PATH_INFO: `/v3/groups/c5265fb9959c4b70b9b5f282160f6827` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:51.988574 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9d919-c48b-4dc3-8b54-f144842c1aa2 None admin] RBAC: Authorizing `identity:get_group(group_id=c5265fb9959c4b70b9b5f282160f6827)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:51.990183 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9d919-c48b-4dc3-8b54-f144842c1aa2 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:51.991784 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 166/313] 10.222.0.23 () {56 vars in 1180 bytes} [Sun Oct 23 00:42:51 2022] GET /identity/v3/groups/c5265fb9959c4b70b9b5f282160f6827 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:51.992890 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1f061-5f21-4dfd-a5f3-639bd02d26fa None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:51.993171 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1f061-5f21-4dfd-a5f3-639bd02d26fa None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:51.993436 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1f061-5f21-4dfd-a5f3-639bd02d26fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:52.015374 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20f017-bc74-43a5-9578-18a459c35ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:52.016053 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20f017-bc74-43a5-9578-18a459c35ff7 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:52.016264 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20f017-bc74-43a5-9578-18a459c35ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:52.016534 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20f017-bc74-43a5-9578-18a459c35ff7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:52.017430 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-c1c1f061-5f21-4dfd-a5f3-639bd02d26fa None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:52.018647 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-c1c1f061-5f21-4dfd-a5f3-639bd02d26fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:52.100973 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d20f017-bc74-43a5-9578-18a459c35ff7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:52.102847 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d20f017-bc74-43a5-9578-18a459c35ff7 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:52.106192 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 167/314] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:42:52.107099 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1f061-5f21-4dfd-a5f3-639bd02d26fa None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:52.167683 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:52.217639 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:52.237175 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 148/315] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 23 00:42:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 00:42:52.238560 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a968fd-dc28-4294-a483-b809b9229b7c None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:52.239449 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a968fd-dc28-4294-a483-b809b9229b7c None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:52.239793 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a968fd-dc28-4294-a483-b809b9229b7c None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:52.241189 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 149/316] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:42:52.241612 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1f061-5f21-4dfd-a5f3-639bd02d26fa None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:52.242015 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a968fd-dc28-4294-a483-b809b9229b7c None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:52.285240 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7786889-fef9-4ad3-9ac5-e54766419ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:52.286299 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7786889-fef9-4ad3-9ac5-e54766419ddd None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:52.287077 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7786889-fef9-4ad3-9ac5-e54766419ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:52.287656 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7786889-fef9-4ad3-9ac5-e54766419ddd None admin] PATH_INFO: `/v3/projects/31a760413eac4b69bea4dd231b89ba6e` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:52.288926 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7786889-fef9-4ad3-9ac5-e54766419ddd None admin] RBAC: Authorizing `identity:get_project(project_id=31a760413eac4b69bea4dd231b89ba6e)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:52.290407 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7786889-fef9-4ad3-9ac5-e54766419ddd None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:52.292048 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 168/317] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 23 00:42:52 2022] GET /identity/v3/projects/31a760413eac4b69bea4dd231b89ba6e => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:52.298246 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7786889-fef9-4ad3-9ac5-e54766419ddd None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:52.377774 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a968fd-dc28-4294-a483-b809b9229b7c None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:52.412047 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7786889-fef9-4ad3-9ac5-e54766419ddd None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:52.416149 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d1d8d-c9f4-407c-aa5a-11d45d8199db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:52.416748 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d1d8d-c9f4-407c-aa5a-11d45d8199db None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:52.417028 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d1d8d-c9f4-407c-aa5a-11d45d8199db None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:52.417298 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d1d8d-c9f4-407c-aa5a-11d45d8199db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:52.418059 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1d1d8d-c9f4-407c-aa5a-11d45d8199db None admin] RBAC: Adding query filter params (group.id=c5265fb9959c4b70b9b5f282160f6827, role.id=130c11043623491c8f8e67ecb6f3efbc, scope.project.id=c072d440807e45aa8ff63548aa916fc2) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:52.418406 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1d1d8d-c9f4-407c-aa5a-11d45d8199db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:52.419854 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1d1d8d-c9f4-407c-aa5a-11d45d8199db None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:52.425436 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 150/318] 10.222.0.23 () {56 vars in 1376 bytes} [Sun Oct 23 00:42:52 2022] GET /identity/v3/role_assignments?group.id=c5265fb9959c4b70b9b5f282160f6827&scope.project.id=c072d440807e45aa8ff63548aa916fc2&role.id=130c11043623491c8f8e67ecb6f3efbc => generated 611 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:52.427135 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865eb3a-ca04-4706-8403-1f9dc3dca4aa None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:52.427413 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865eb3a-ca04-4706-8403-1f9dc3dca4aa None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:52.427681 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865eb3a-ca04-4706-8403-1f9dc3dca4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:52.447906 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-9865eb3a-ca04-4706-8403-1f9dc3dca4aa None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:52.449164 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-9865eb3a-ca04-4706-8403-1f9dc3dca4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:52.461206 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:52.462800 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a6173-e09c-4e01-8b6e-8c2dc7f3247d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:52.463627 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a6173-e09c-4e01-8b6e-8c2dc7f3247d None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:52.463743 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a6173-e09c-4e01-8b6e-8c2dc7f3247d None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:52.463976 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a6173-e09c-4e01-8b6e-8c2dc7f3247d None admin] PATH_INFO: `/v3/projects/31a760413eac4b69bea4dd231b89ba6e` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:52.465286 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408a6173-e09c-4e01-8b6e-8c2dc7f3247d None admin] RBAC: Authorizing `identity:get_project(project_id=31a760413eac4b69bea4dd231b89ba6e)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:52.467368 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408a6173-e09c-4e01-8b6e-8c2dc7f3247d None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:52.469780 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 169/319] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 23 00:42:52 2022] GET /identity/v3/projects/31a760413eac4b69bea4dd231b89ba6e => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:52.470532 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a6173-e09c-4e01-8b6e-8c2dc7f3247d None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:52.501229 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:52.534706 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 151/320] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:42:52.547649 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9865eb3a-ca04-4706-8403-1f9dc3dca4aa None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:52.600610 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a6173-e09c-4e01-8b6e-8c2dc7f3247d None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:52.645667 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0dc56b-845a-498d-9d1a-d2dce236444b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:52.646453 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0dc56b-845a-498d-9d1a-d2dce236444b None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:52.646736 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0dc56b-845a-498d-9d1a-d2dce236444b None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:52.647009 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0dc56b-845a-498d-9d1a-d2dce236444b None admin] PATH_INFO: `/v3/groups/c5265fb9959c4b70b9b5f282160f6827` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:52.648122 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0dc56b-845a-498d-9d1a-d2dce236444b None admin] RBAC: Authorizing `identity:get_group(group_id=c5265fb9959c4b70b9b5f282160f6827)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:52.650017 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0dc56b-845a-498d-9d1a-d2dce236444b None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:52.652169 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 170/321] 10.222.0.23 () {56 vars in 1180 bytes} [Sun Oct 23 00:42:52 2022] GET /identity/v3/groups/c5265fb9959c4b70b9b5f282160f6827 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:52.657042 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0dc56b-845a-498d-9d1a-d2dce236444b None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:52.685856 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9865eb3a-ca04-4706-8403-1f9dc3dca4aa None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:52.726951 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c9654-457a-434c-94d2-8a6d1b65dc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:52.727694 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c9654-457a-434c-94d2-8a6d1b65dc7a None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:52.727996 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c9654-457a-434c-94d2-8a6d1b65dc7a None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:52.728347 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c9654-457a-434c-94d2-8a6d1b65dc7a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:52.739583 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c9654-457a-434c-94d2-8a6d1b65dc7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:42:52.744788 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-004c9654-457a-434c-94d2-8a6d1b65dc7a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 00:42:52.744788 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:42:52.744788 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:42:52.744788 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:42:52.744788 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:42:52.744788 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:42:52.744788 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:42:52.744788 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:42:52.744788 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:42:52.744788 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:42:52.744788 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:42:52.744788 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:42:52.744788 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:42:52.744788 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:42:52.744788 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:42:52.744788 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:42:52.745663 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:42:52.745663 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:42:52.745663 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:42:52.745663 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:42:52.745663 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:42:52.745663 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:42:52.745663 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:42:52.745663 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:42:52.745663 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:42:52.745663 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:42:52.745663 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:42:52.745663 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:42:52.745663 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:42:52.745663 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:42:52.745663 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:42:52.745663 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:42:52.746921 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:42:52.746921 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:42:52.746921 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:42:52.746921 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:42:52.746921 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:42:52.746921 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:42:52.746921 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:42:52.746921 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:42:52.746921 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:42:52.746921 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:42:52.746921 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 00:42:52.746921 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:42:52.746921 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 152/322] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 23 00:42:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:42:52.746921 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c9654-457a-434c-94d2-8a6d1b65dc7a None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:52.755236 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:52.757926 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:52.765900 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0dc56b-845a-498d-9d1a-d2dce236444b None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:52.802795 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f930c6-56a5-4e86-a41a-838cab84e62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:52.803789 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f930c6-56a5-4e86-a41a-838cab84e62b None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:52.804077 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f930c6-56a5-4e86-a41a-838cab84e62b None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:52.804665 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f930c6-56a5-4e86-a41a-838cab84e62b None admin] PATH_INFO: `/v3/groups/c5265fb9959c4b70b9b5f282160f6827` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:52.805802 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f930c6-56a5-4e86-a41a-838cab84e62b None admin] RBAC: Authorizing `identity:get_group(group_id=c5265fb9959c4b70b9b5f282160f6827)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:52.807336 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f930c6-56a5-4e86-a41a-838cab84e62b None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:52.809100 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 171/323] 10.222.0.23 () {56 vars in 1180 bytes} [Sun Oct 23 00:42:52 2022] GET /identity/v3/groups/c5265fb9959c4b70b9b5f282160f6827 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:52.809928 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f930c6-56a5-4e86-a41a-838cab84e62b None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:52.859998 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c9654-457a-434c-94d2-8a6d1b65dc7a None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:52.893506 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39ebed-dfc0-4864-85ed-9602b6747904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:52.894119 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39ebed-dfc0-4864-85ed-9602b6747904 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:52.894404 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39ebed-dfc0-4864-85ed-9602b6747904 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:52.894676 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39ebed-dfc0-4864-85ed-9602b6747904 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:52.895926 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a39ebed-dfc0-4864-85ed-9602b6747904 None admin] RBAC: Adding query filter params (group.id=c5265fb9959c4b70b9b5f282160f6827, role.id=130c11043623491c8f8e67ecb6f3efbc, scope.project.id=31a760413eac4b69bea4dd231b89ba6e) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:52.896227 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a39ebed-dfc0-4864-85ed-9602b6747904 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:52.897705 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a39ebed-dfc0-4864-85ed-9602b6747904 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:52.903320 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 153/324] 10.222.0.23 () {56 vars in 1376 bytes} [Sun Oct 23 00:42:52 2022] GET /identity/v3/role_assignments?group.id=c5265fb9959c4b70b9b5f282160f6827&scope.project.id=31a760413eac4b69bea4dd231b89ba6e&role.id=130c11043623491c8f8e67ecb6f3efbc => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:52.904094 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39ebed-dfc0-4864-85ed-9602b6747904 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:52.908662 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f930c6-56a5-4e86-a41a-838cab84e62b None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:52.947171 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e09782-e8cf-4f99-9c21-a33784d01cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:52.948166 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e09782-e8cf-4f99-9c21-a33784d01cbf None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:52.948657 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e09782-e8cf-4f99-9c21-a33784d01cbf None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:52.949129 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e09782-e8cf-4f99-9c21-a33784d01cbf None admin] PATH_INFO: `/v3/roles` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:52.950021 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e09782-e8cf-4f99-9c21-a33784d01cbf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:52.950435 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e09782-e8cf-4f99-9c21-a33784d01cbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:52.951847 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e09782-e8cf-4f99-9c21-a33784d01cbf None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:52.966486 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 172/325] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 23 00:42:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:52.967347 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e09782-e8cf-4f99-9c21-a33784d01cbf None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:52.981599 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:52.991491 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:53.025301 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39ebed-dfc0-4864-85ed-9602b6747904 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:53.068668 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcaa43f-bc52-4a54-a9b8-ff1926f3753d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:53.069305 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcaa43f-bc52-4a54-a9b8-ff1926f3753d None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:53.069587 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcaa43f-bc52-4a54-a9b8-ff1926f3753d None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:53.069862 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcaa43f-bc52-4a54-a9b8-ff1926f3753d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:53.078676 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e09782-e8cf-4f99-9c21-a33784d01cbf None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:53.081737 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcaa43f-bc52-4a54-a9b8-ff1926f3753d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:42:53.087713 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-3fcaa43f-bc52-4a54-a9b8-ff1926f3753d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:42:53.087713 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:42:53.087713 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:42:53.087713 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:42:53.087713 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:42:53.087713 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:42:53.087713 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:42:53.087713 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:42:53.087713 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:42:53.087713 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:42:53.087713 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:42:53.087713 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:42:53.087713 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:42:53.087713 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:42:53.087713 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:42:53.087713 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:42:53.088763 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:42:53.088763 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:42:53.088763 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:42:53.088763 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:42:53.088763 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:42:53.088763 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:42:53.088763 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:42:53.088763 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:42:53.088763 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:42:53.088763 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:42:53.088763 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:42:53.088763 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:42:53.088763 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:42:53.088763 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:42:53.088763 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:42:53.088763 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:42:53.089801 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:42:53.089801 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:42:53.089801 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:42:53.089801 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:42:53.089801 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:42:53.089801 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:42:53.089801 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:42:53.089801 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:42:53.089801 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:42:53.089801 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:42:53.089801 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:42:53.089801 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:42:53.089801 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 154/326] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 23 00:42:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:42:53.089801 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcaa43f-bc52-4a54-a9b8-ff1926f3753d None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:53.127461 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147a951-c40e-494e-a3f6-02c213e3ddf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:53.128073 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147a951-c40e-494e-a3f6-02c213e3ddf4 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:53.128359 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147a951-c40e-494e-a3f6-02c213e3ddf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:53.128640 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147a951-c40e-494e-a3f6-02c213e3ddf4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:53.129374 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b147a951-c40e-494e-a3f6-02c213e3ddf4 None admin] RBAC: Adding query filter params (group.id=c5265fb9959c4b70b9b5f282160f6827, role.id=9f802c7a3366414c9d0ee9e7a4cb5b74, scope.project.id=31a760413eac4b69bea4dd231b89ba6e) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:53.129715 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b147a951-c40e-494e-a3f6-02c213e3ddf4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:53.131207 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b147a951-c40e-494e-a3f6-02c213e3ddf4 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:53.140179 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 173/327] 10.222.0.23 () {56 vars in 1376 bytes} [Sun Oct 23 00:42:52 2022] GET /identity/v3/role_assignments?group.id=c5265fb9959c4b70b9b5f282160f6827&scope.project.id=31a760413eac4b69bea4dd231b89ba6e&role.id=9f802c7a3366414c9d0ee9e7a4cb5b74 => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:53.141296 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147a951-c40e-494e-a3f6-02c213e3ddf4 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:53.225287 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcaa43f-bc52-4a54-a9b8-ff1926f3753d None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:53.271896 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:53.275645 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:53.286372 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b12123-c24f-4cc3-b9ec-88c479091f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:53.287352 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b12123-c24f-4cc3-b9ec-88c479091f11 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:53.287640 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b12123-c24f-4cc3-b9ec-88c479091f11 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:53.287917 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b12123-c24f-4cc3-b9ec-88c479091f11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:53.297988 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147a951-c40e-494e-a3f6-02c213e3ddf4 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:53.344482 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47789e-7422-47bc-a82f-427b1e102579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:53.345094 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47789e-7422-47bc-a82f-427b1e102579 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:53.345373 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47789e-7422-47bc-a82f-427b1e102579 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:53.345642 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47789e-7422-47bc-a82f-427b1e102579 None admin] PATH_INFO: `/v3/roles` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:53.346686 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a47789e-7422-47bc-a82f-427b1e102579 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:53.346949 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a47789e-7422-47bc-a82f-427b1e102579 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:53.348689 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a47789e-7422-47bc-a82f-427b1e102579 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:53.359993 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 174/328] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 23 00:42:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:53.366761 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47789e-7422-47bc-a82f-427b1e102579 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:53.378710 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b12123-c24f-4cc3-b9ec-88c479091f11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:53.380736 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b12123-c24f-4cc3-b9ec-88c479091f11 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:53.488709 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47789e-7422-47bc-a82f-427b1e102579 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:53.497660 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 155/329] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 23 00:42:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 00:42:53.503278 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b12123-c24f-4cc3-b9ec-88c479091f11 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:53.528846 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d4fcb-4c5e-4acb-b0fe-062504c4f1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:53.529682 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d4fcb-4c5e-4acb-b0fe-062504c4f1bd None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:53.530165 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d4fcb-4c5e-4acb-b0fe-062504c4f1bd None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:53.530579 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d4fcb-4c5e-4acb-b0fe-062504c4f1bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:53.532322 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:53.547696 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:53.608402 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d4fcb-4c5e-4acb-b0fe-062504c4f1bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:53.609874 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d4fcb-4c5e-4acb-b0fe-062504c4f1bd None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:53.624623 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b12123-c24f-4cc3-b9ec-88c479091f11 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:53.663840 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b1ccc6-436e-4765-b9ad-6dd5201e2fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:53.664473 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1ccc6-436e-4765-b9ad-6dd5201e2fe8 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:53.664748 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1ccc6-436e-4765-b9ad-6dd5201e2fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:53.665017 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1ccc6-436e-4765-b9ad-6dd5201e2fe8 None admin] PATH_INFO: `/v3/projects/c072d440807e45aa8ff63548aa916fc2` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:53.666153 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b1ccc6-436e-4765-b9ad-6dd5201e2fe8 None admin] RBAC: Authorizing `identity:get_project(project_id=c072d440807e45aa8ff63548aa916fc2)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:53.667585 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b1ccc6-436e-4765-b9ad-6dd5201e2fe8 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:53.669410 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 156/330] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 23 00:42:53 2022] GET /identity/v3/projects/c072d440807e45aa8ff63548aa916fc2 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:42:53.674616 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b1ccc6-436e-4765-b9ad-6dd5201e2fe8 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:53.724368 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 175/331] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 23 00:42:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 00:42:53.729933 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d4fcb-4c5e-4acb-b0fe-062504c4f1bd None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:53.773736 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:53.776536 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:53.780079 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b1ccc6-436e-4765-b9ad-6dd5201e2fe8 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:53.814594 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f702e8-2403-43ee-bb3a-1cf75834ba91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:53.815212 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f702e8-2403-43ee-bb3a-1cf75834ba91 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:53.815495 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f702e8-2403-43ee-bb3a-1cf75834ba91 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:53.815769 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f702e8-2403-43ee-bb3a-1cf75834ba91 None admin] PATH_INFO: `/v3/groups/c5265fb9959c4b70b9b5f282160f6827` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:53.816875 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f702e8-2403-43ee-bb3a-1cf75834ba91 None admin] RBAC: Authorizing `identity:get_group(group_id=c5265fb9959c4b70b9b5f282160f6827)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:53.818928 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f702e8-2403-43ee-bb3a-1cf75834ba91 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:53.820583 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 157/332] 10.222.0.23 () {56 vars in 1180 bytes} [Sun Oct 23 00:42:53 2022] GET /identity/v3/groups/c5265fb9959c4b70b9b5f282160f6827 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:42:53.826313 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f702e8-2403-43ee-bb3a-1cf75834ba91 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:53.830991 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d4fcb-4c5e-4acb-b0fe-062504c4f1bd None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:53.866222 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf02e7e-35ff-4681-af68-5e3eddfe8178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:53.866938 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf02e7e-35ff-4681-af68-5e3eddfe8178 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:53.867535 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf02e7e-35ff-4681-af68-5e3eddfe8178 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:53.867818 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf02e7e-35ff-4681-af68-5e3eddfe8178 None admin] PATH_INFO: `/v3/projects/1e595cb6a4664ac2825c0ea6a16cb095` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:53.869092 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf02e7e-35ff-4681-af68-5e3eddfe8178 None admin] RBAC: Authorizing `identity:get_project(project_id=1e595cb6a4664ac2825c0ea6a16cb095)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:53.870900 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf02e7e-35ff-4681-af68-5e3eddfe8178 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:53.872543 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 176/333] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 23 00:42:53 2022] GET /identity/v3/projects/1e595cb6a4664ac2825c0ea6a16cb095 => generated 344 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:42:53.878007 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf02e7e-35ff-4681-af68-5e3eddfe8178 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:53.921783 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f702e8-2403-43ee-bb3a-1cf75834ba91 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:53.957490 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b3e551-3899-4e36-aa4a-a08da5c84b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:53.958283 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3e551-3899-4e36-aa4a-a08da5c84b78 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:53.958566 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3e551-3899-4e36-aa4a-a08da5c84b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:53.958839 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3e551-3899-4e36-aa4a-a08da5c84b78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:53.959565 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b3e551-3899-4e36-aa4a-a08da5c84b78 None admin] RBAC: Adding query filter params (group.id=c5265fb9959c4b70b9b5f282160f6827, role.id=9f802c7a3366414c9d0ee9e7a4cb5b74, scope.project.id=c072d440807e45aa8ff63548aa916fc2) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:53.959878 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b3e551-3899-4e36-aa4a-a08da5c84b78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:53.961299 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b3e551-3899-4e36-aa4a-a08da5c84b78 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:53.967200 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 158/334] 10.222.0.23 () {56 vars in 1376 bytes} [Sun Oct 23 00:42:53 2022] GET /identity/v3/role_assignments?group.id=c5265fb9959c4b70b9b5f282160f6827&scope.project.id=c072d440807e45aa8ff63548aa916fc2&role.id=9f802c7a3366414c9d0ee9e7a4cb5b74 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:42:53.974679 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf02e7e-35ff-4681-af68-5e3eddfe8178 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:53.991180 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:54.013293 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ab340-27c8-4b03-b4dc-cd4862408596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:54.013935 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ab340-27c8-4b03-b4dc-cd4862408596 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:54.014252 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ab340-27c8-4b03-b4dc-cd4862408596 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:54.014531 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ab340-27c8-4b03-b4dc-cd4862408596 None admin] PATH_INFO: `/v3/groups/d3659ac9c6244e85b1054122e78db820` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:54.015673 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7ab340-27c8-4b03-b4dc-cd4862408596 None admin] RBAC: Authorizing `identity:get_group(group_id=d3659ac9c6244e85b1054122e78db820)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:54.017152 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7ab340-27c8-4b03-b4dc-cd4862408596 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:54.018891 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 177/335] 10.222.0.23 () {56 vars in 1180 bytes} [Sun Oct 23 00:42:53 2022] GET /identity/v3/groups/d3659ac9c6244e85b1054122e78db820 => generated 229 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:42:54.025317 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b3e551-3899-4e36-aa4a-a08da5c84b78 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:54.055653 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:54.131111 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b3e551-3899-4e36-aa4a-a08da5c84b78 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:54.165545 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af54e1-9005-4cf2-9eb2-d0f381ab5993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:54.166302 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af54e1-9005-4cf2-9eb2-d0f381ab5993 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:54.166581 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af54e1-9005-4cf2-9eb2-d0f381ab5993 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:54.166852 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af54e1-9005-4cf2-9eb2-d0f381ab5993 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:54.167572 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af54e1-9005-4cf2-9eb2-d0f381ab5993 None admin] RBAC: Adding query filter params (group.id=d3659ac9c6244e85b1054122e78db820, role.id=1e2073be75174689aa4fac29e674583d, scope.project.id=1e595cb6a4664ac2825c0ea6a16cb095) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:54.167876 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af54e1-9005-4cf2-9eb2-d0f381ab5993 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:54.169316 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af54e1-9005-4cf2-9eb2-d0f381ab5993 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:54.175188 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 159/336] 10.222.0.23 () {56 vars in 1376 bytes} [Sun Oct 23 00:42:54 2022] GET /identity/v3/role_assignments?group.id=d3659ac9c6244e85b1054122e78db820&scope.project.id=1e595cb6a4664ac2825c0ea6a16cb095&role.id=1e2073be75174689aa4fac29e674583d => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:56.883033 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168dfa65-a8e9-480d-b1e5-2bb66a894d9e None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:56.884078 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168dfa65-a8e9-480d-b1e5-2bb66a894d9e None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:56.884569 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168dfa65-a8e9-480d-b1e5-2bb66a894d9e None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:56.886154 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 178/337] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:42:56.891508 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b88cb-56b2-4b39-ac14-96c4c35c0afa None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:56.892297 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b88cb-56b2-4b39-ac14-96c4c35c0afa None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:56.892773 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b88cb-56b2-4b39-ac14-96c4c35c0afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:56.914921 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-c40b88cb-56b2-4b39-ac14-96c4c35c0afa None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:56.916463 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-c40b88cb-56b2-4b39-ac14-96c4c35c0afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:56.958899 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7686b6a-8ce2-4e22-9fc0-cde31a60da9a None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:56.959529 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7686b6a-8ce2-4e22-9fc0-cde31a60da9a None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:56.960013 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7686b6a-8ce2-4e22-9fc0-cde31a60da9a None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:56.961824 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 179/338] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:42:56.967794 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3367c5-26fb-441e-af60-75fbc8e9eb69 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:56.968139 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3367c5-26fb-441e-af60-75fbc8e9eb69 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:56.968347 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3367c5-26fb-441e-af60-75fbc8e9eb69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:57.000227 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-ff3367c5-26fb-441e-af60-75fbc8e9eb69 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:57.001443 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-ff3367c5-26fb-441e-af60-75fbc8e9eb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:57.032787 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 160/339] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:42:57.095183 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 180/340] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 00:42:57.189914 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcef8f-c0c2-476f-bfc9-fd8deea87ebf None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:57.190117 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcef8f-c0c2-476f-bfc9-fd8deea87ebf None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:57.190403 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcef8f-c0c2-476f-bfc9-fd8deea87ebf None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:57.191922 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 161/341] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:42:57.197485 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833b960-6975-404d-8fac-e2d79938c730 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:57.197773 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833b960-6975-404d-8fac-e2d79938c730 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:57.198046 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833b960-6975-404d-8fac-e2d79938c730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:57.220271 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-4833b960-6975-404d-8fac-e2d79938c730 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:57.221455 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-4833b960-6975-404d-8fac-e2d79938c730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:57.308716 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 181/342] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:42:57.411565 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fcef8f-c0c2-476f-bfc9-fd8deea87ebf None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:57.436801 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:57.473741 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833b960-6975-404d-8fac-e2d79938c730 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:57.538534 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:57.541882 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fcef8f-c0c2-476f-bfc9-fd8deea87ebf None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:57.616122 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3a016-58e3-41ef-98e0-e4da639d298d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:57.616755 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3a016-58e3-41ef-98e0-e4da639d298d None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:57.617034 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3a016-58e3-41ef-98e0-e4da639d298d None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:57.617306 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3a016-58e3-41ef-98e0-e4da639d298d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:57.644666 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf3a016-58e3-41ef-98e0-e4da639d298d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:57.646192 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf3a016-58e3-41ef-98e0-e4da639d298d None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:57.648458 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833b960-6975-404d-8fac-e2d79938c730 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:57.671886 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-cbf3a016-58e3-41ef-98e0-e4da639d298d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:42:57.671886 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:42:57.671886 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:42:57.671886 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:42:57.671886 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:42:57.671886 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:42:57.671886 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:42:57.671886 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:42:57.671886 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:42:57.671886 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:42:57.671886 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:42:57.671886 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:42:57.671886 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:42:57.671886 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:42:57.671886 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:42:57.671886 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:42:57.672910 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:42:57.672910 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:42:57.672910 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:42:57.672910 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:42:57.672910 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:42:57.672910 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:42:57.672910 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:42:57.672910 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:42:57.672910 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:42:57.672910 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:42:57.672910 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:42:57.672910 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:42:57.672910 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:42:57.672910 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:42:57.672910 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:42:57.672910 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:42:57.672910 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:42:57.674431 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:42:57.674431 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:42:57.674431 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:42:57.674431 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 162/343] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:42:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:42:57.674431 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cb070-cb84-4bca-87cd-c3941590d7dc None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:57.674431 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cb070-cb84-4bca-87cd-c3941590d7dc None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:57.674789 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cb070-cb84-4bca-87cd-c3941590d7dc None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:57.675919 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 163/344] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:42:57.681254 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0cb070-cb84-4bca-87cd-c3941590d7dc None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:57.699306 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc53b3c-688f-40ed-99be-0bacb1b776c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:57.699946 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc53b3c-688f-40ed-99be-0bacb1b776c5 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:57.700224 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc53b3c-688f-40ed-99be-0bacb1b776c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:57.700494 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc53b3c-688f-40ed-99be-0bacb1b776c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:57.711297 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc53b3c-688f-40ed-99be-0bacb1b776c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:57.712747 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc53b3c-688f-40ed-99be-0bacb1b776c5 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:57.728927 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-5bc53b3c-688f-40ed-99be-0bacb1b776c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:42:57.728927 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:42:57.728927 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:42:57.728927 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:42:57.728927 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:42:57.728927 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:42:57.728927 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:42:57.728927 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:42:57.728927 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:42:57.728927 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:42:57.728927 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:42:57.728927 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:42:57.728927 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:42:57.728927 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:42:57.728927 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:42:57.728927 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:42:57.729812 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:42:57.729812 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:42:57.729812 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:42:57.729812 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:42:57.729812 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:42:57.729812 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:42:57.729812 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:42:57.729812 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:42:57.729812 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:42:57.729812 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:42:57.729812 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:42:57.729812 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:42:57.729812 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:42:57.729812 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:42:57.729812 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:42:57.729812 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:42:57.729812 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:42:57.736137 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:42:57.736137 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:42:57.736137 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:42:57.736137 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 182/345] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:42:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:42:57.736137 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11126e57-ede5-4226-b13d-e28be8a67002 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:57.736137 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11126e57-ede5-4226-b13d-e28be8a67002 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:57.736137 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11126e57-ede5-4226-b13d-e28be8a67002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:57.752668 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-11126e57-ede5-4226-b13d-e28be8a67002 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:57.753839 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-11126e57-ede5-4226-b13d-e28be8a67002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:57.763203 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:57.792545 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0cb070-cb84-4bca-87cd-c3941590d7dc None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:57.830888 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025b3af-a840-4f77-9f91-0e4a3d7f981a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:57.838311 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 183/346] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:42:57.838500 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025b3af-a840-4f77-9f91-0e4a3d7f981a None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:57.838500 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025b3af-a840-4f77-9f91-0e4a3d7f981a None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:57.838500 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025b3af-a840-4f77-9f91-0e4a3d7f981a None admin] PATH_INFO: `/v3/domains` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:57.838706 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11126e57-ede5-4226-b13d-e28be8a67002 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:57.838780 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8025b3af-a840-4f77-9f91-0e4a3d7f981a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:57.838780 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8025b3af-a840-4f77-9f91-0e4a3d7f981a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:57.838780 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8025b3af-a840-4f77-9f91-0e4a3d7f981a None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:57.850022 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 164/347] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:57.850934 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025b3af-a840-4f77-9f91-0e4a3d7f981a None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:57.865141 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:57.952960 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11126e57-ede5-4226-b13d-e28be8a67002 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:57.960094 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025b3af-a840-4f77-9f91-0e4a3d7f981a None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:57.997249 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa89e79-e4ae-4729-a04f-3be7451a7d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:57.997803 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa89e79-e4ae-4729-a04f-3be7451a7d89 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:57.998101 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa89e79-e4ae-4729-a04f-3be7451a7d89 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:57.998391 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa89e79-e4ae-4729-a04f-3be7451a7d89 None admin] PATH_INFO: `/v3/domains` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:57.999084 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa89e79-e4ae-4729-a04f-3be7451a7d89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:57.999411 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa89e79-e4ae-4729-a04f-3be7451a7d89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:58.000671 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8fae22-9a7e-4602-8be6-b808707c95ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:58.000807 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa89e79-e4ae-4729-a04f-3be7451a7d89 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:58.001565 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fae22-9a7e-4602-8be6-b808707c95ac None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:58.002294 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:58.002609 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fae22-9a7e-4602-8be6-b808707c95ac None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:58.003086 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fae22-9a7e-4602-8be6-b808707c95ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:58.016851 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8fae22-9a7e-4602-8be6-b808707c95ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:58.018380 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 165/348] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:58.018766 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8fae22-9a7e-4602-8be6-b808707c95ac None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:58.019334 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa89e79-e4ae-4729-a04f-3be7451a7d89 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:58.038957 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-1f8fae22-9a7e-4602-8be6-b808707c95ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:42:58.038957 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:42:58.038957 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:42:58.038957 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:42:58.038957 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:42:58.038957 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:42:58.038957 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:42:58.038957 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:42:58.038957 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:42:58.038957 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:42:58.038957 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:42:58.038957 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:42:58.038957 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:42:58.038957 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:42:58.038957 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:42:58.038957 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:42:58.040094 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:42:58.040094 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:42:58.040094 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:42:58.040094 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:42:58.040094 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:42:58.040094 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:42:58.040094 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:42:58.040094 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:42:58.040094 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:42:58.040094 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:42:58.040094 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:42:58.040094 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:42:58.040094 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:42:58.040094 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:42:58.040094 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:42:58.040094 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:42:58.040094 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:42:58.041125 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:42:58.041125 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:42:58.041125 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:42:58.043183 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 184/349] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:42:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:42:58.044191 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8fae22-9a7e-4602-8be6-b808707c95ac None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:58.144475 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:58.144796 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa89e79-e4ae-4729-a04f-3be7451a7d89 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:58.171849 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8fae22-9a7e-4602-8be6-b808707c95ac None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:58.183649 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37bde24-d388-41a0-9623-9472b78575b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:58.184273 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bde24-d388-41a0-9623-9472b78575b4 None admin] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:58.184554 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bde24-d388-41a0-9623-9472b78575b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:58.184827 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bde24-d388-41a0-9623-9472b78575b4 None admin] PATH_INFO: `/v3/users` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:58.185493 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37bde24-d388-41a0-9623-9472b78575b4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:58.187048 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37bde24-d388-41a0-9623-9472b78575b4 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:58.210864 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 166/350] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 23 00:42:58 2022] POST /identity/v3/users => generated 248 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:42:58.211993 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d9beb-5408-4bb4-a319-84f7b56bbd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:58.212616 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d9beb-5408-4bb4-a319-84f7b56bbd19 None admin] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:58.212901 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d9beb-5408-4bb4-a319-84f7b56bbd19 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:58.213172 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d9beb-5408-4bb4-a319-84f7b56bbd19 None admin] PATH_INFO: `/v3/users` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:58.213871 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d9beb-5408-4bb4-a319-84f7b56bbd19 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:58.215644 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d9beb-5408-4bb4-a319-84f7b56bbd19 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:58.225346 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37bde24-d388-41a0-9623-9472b78575b4 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:58.254296 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 185/351] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 23 00:42:58 2022] POST /identity/v3/users => generated 246 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:42:58.254296 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d9beb-5408-4bb4-a319-84f7b56bbd19 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:58.327226 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:58.397783 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37bde24-d388-41a0-9623-9472b78575b4 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:58.416586 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d9beb-5408-4bb4-a319-84f7b56bbd19 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:58.448563 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543785b-0060-4fa4-aec6-98a45255c04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:58.449187 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543785b-0060-4fa4-aec6-98a45255c04d None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:58.449470 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543785b-0060-4fa4-aec6-98a45255c04d None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:58.449747 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543785b-0060-4fa4-aec6-98a45255c04d None admin] PATH_INFO: `/v3/domains` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:58.450442 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5543785b-0060-4fa4-aec6-98a45255c04d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:58.450735 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5543785b-0060-4fa4-aec6-98a45255c04d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:58.452008 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:58.452978 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5543785b-0060-4fa4-aec6-98a45255c04d None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:58.459435 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee05aa4-c33e-410e-9918-2789a7a002db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:58.460540 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee05aa4-c33e-410e-9918-2789a7a002db None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:58.460811 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee05aa4-c33e-410e-9918-2789a7a002db None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:58.461931 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee05aa4-c33e-410e-9918-2789a7a002db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:58.468924 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 167/352] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:42:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:58.470978 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed759b59-65ec-4e99-90ba-6e9a992c32c8 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:58.471269 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed759b59-65ec-4e99-90ba-6e9a992c32c8 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:58.471544 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed759b59-65ec-4e99-90ba-6e9a992c32c8 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:58.472912 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 168/353] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:42:58.475400 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee05aa4-c33e-410e-9918-2789a7a002db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:58.476886 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee05aa4-c33e-410e-9918-2789a7a002db None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:58.478249 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed759b59-65ec-4e99-90ba-6e9a992c32c8 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:58.495218 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-7ee05aa4-c33e-410e-9918-2789a7a002db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:42:58.495218 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:42:58.495218 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:42:58.495218 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:42:58.495218 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:42:58.495218 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:42:58.495218 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:42:58.495218 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:42:58.495218 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:42:58.495218 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:42:58.495218 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:42:58.495218 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:42:58.495218 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:42:58.495218 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:42:58.495218 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:42:58.495218 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:42:58.496146 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:42:58.496146 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:42:58.496146 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:42:58.496146 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:42:58.496146 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:42:58.496146 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:42:58.496146 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:42:58.496146 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:42:58.496146 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:42:58.496146 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:42:58.496146 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:42:58.496146 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:42:58.496146 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:42:58.496146 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:42:58.496146 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:42:58.496146 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:42:58.496146 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:42:58.496964 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:42:58.496964 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:42:58.496964 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:42:58.496964 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 186/354] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:42:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:42:58.497880 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c8479-f2c0-428d-a467-45ebf915eaf7 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:58.498216 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c8479-f2c0-428d-a467-45ebf915eaf7 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:58.498497 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c8479-f2c0-428d-a467-45ebf915eaf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:58.523917 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-560c8479-f2c0-428d-a467-45ebf915eaf7 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:42:58.525024 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-560c8479-f2c0-428d-a467-45ebf915eaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:42:58.599222 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 187/355] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:42:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:42:58.606170 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed759b59-65ec-4e99-90ba-6e9a992c32c8 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:58.607324 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c8479-f2c0-428d-a467-45ebf915eaf7 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:58.611970 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:58.643360 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce56d7-d144-47ab-a689-9134471918ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:58.643360 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce56d7-d144-47ab-a689-9134471918ad None admin] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:58.643360 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce56d7-d144-47ab-a689-9134471918ad None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:58.643360 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce56d7-d144-47ab-a689-9134471918ad None admin] PATH_INFO: `/v3/users` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:58.643822 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ce56d7-d144-47ab-a689-9134471918ad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:58.643822 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ce56d7-d144-47ab-a689-9134471918ad None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:58.673483 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 169/356] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 23 00:42:58 2022] POST /identity/v3/users => generated 248 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:42:58.763694 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c8479-f2c0-428d-a467-45ebf915eaf7 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:58.783423 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:58.808582 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c9542b-8b79-4d51-810d-9e87c99dba83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:58.809196 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9542b-8b79-4d51-810d-9e87c99dba83 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:58.809474 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9542b-8b79-4d51-810d-9e87c99dba83 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:58.809743 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9542b-8b79-4d51-810d-9e87c99dba83 None admin] PATH_INFO: `/v3/domains` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:58.810413 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c9542b-8b79-4d51-810d-9e87c99dba83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:58.810713 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c9542b-8b79-4d51-810d-9e87c99dba83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:58.812164 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c9542b-8b79-4d51-810d-9e87c99dba83 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:58.837955 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 188/357] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:42:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:42:58.843324 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce56d7-d144-47ab-a689-9134471918ad None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:58.953517 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce56d7-d144-47ab-a689-9134471918ad None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:58.976801 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c9542b-8b79-4d51-810d-9e87c99dba83 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:58.993516 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d3c98-bb9b-48fe-a9cc-46483287eafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:58.994206 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d3c98-bb9b-48fe-a9cc-46483287eafa None admin] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:58.994447 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d3c98-bb9b-48fe-a9cc-46483287eafa None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:58.994723 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d3c98-bb9b-48fe-a9cc-46483287eafa None admin] PATH_INFO: `/v3/users` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:58.995444 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d3c98-bb9b-48fe-a9cc-46483287eafa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:58.997062 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d3c98-bb9b-48fe-a9cc-46483287eafa None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:59.039899 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 170/358] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 23 00:42:58 2022] POST /identity/v3/users => generated 249 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:42:59.131317 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c9542b-8b79-4d51-810d-9e87c99dba83 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:59.170896 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b0cc1-3979-49e3-9fc2-9d4ba654bc8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:59.171939 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b0cc1-3979-49e3-9fc2-9d4ba654bc8c None admin] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:59.172484 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b0cc1-3979-49e3-9fc2-9d4ba654bc8c None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:59.172970 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b0cc1-3979-49e3-9fc2-9d4ba654bc8c None admin] PATH_INFO: `/v3/roles` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:59.173873 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b0cc1-3979-49e3-9fc2-9d4ba654bc8c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:59.175577 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b0cc1-3979-49e3-9fc2-9d4ba654bc8c None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:59.188795 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.sql.core [None req-eb0b0cc1-3979-49e3-9fc2-9d4ba654bc8c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 23 00:42:59.188795 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 23 00:42:59.188795 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [parameters: {'id': 'eefbd74d3a4e4c97966d49e0fda7cc9d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 23 00:42:59.188795 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81359) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 23 00:42:59.208170 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-eb0b0cc1-3979-49e3-9fc2-9d4ba654bc8c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 23 00:42:59.208170 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:42:59.208170 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 23 00:42:59.208170 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 23 00:42:59.208170 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 23 00:42:59.208170 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 23 00:42:59.208170 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 23 00:42:59.208170 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application result = self._query(query) Oct 23 00:42:59.208170 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 23 00:42:59.208170 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application conn.query(q) Oct 23 00:42:59.208170 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 23 00:42:59.208170 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 23 00:42:59.208170 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 23 00:42:59.208170 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application result.read() Oct 23 00:42:59.208170 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 23 00:42:59.209111 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 23 00:42:59.209111 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 23 00:42:59.209111 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 23 00:42:59.209111 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 23 00:42:59.209111 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 23 00:42:59.209111 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 23 00:42:59.209111 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 23 00:42:59.209111 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 23 00:42:59.209111 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:42:59.209111 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 23 00:42:59.209111 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:42:59.209111 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:42:59.209111 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 23 00:42:59.209111 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 23 00:42:59.209111 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 23 00:42:59.209111 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return ref.to_dict() Oct 23 00:42:59.209111 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 23 00:42:59.209111 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application next(self.gen) Oct 23 00:42:59.210068 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 23 00:42:59.210068 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application yield resource Oct 23 00:42:59.210068 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 23 00:42:59.210068 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application next(self.gen) Oct 23 00:42:59.210068 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 23 00:42:59.210068 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application self.session.rollback() Oct 23 00:42:59.210068 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 00:42:59.210068 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application self.force_reraise() Oct 23 00:42:59.210068 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 00:42:59.210068 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise self.value Oct 23 00:42:59.210068 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 23 00:42:59.210068 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 23 00:42:59.210068 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 23 00:42:59.210068 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application session.commit() Oct 23 00:42:59.210068 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 23 00:42:59.210068 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 23 00:42:59.210068 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 23 00:42:59.211568 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application self._prepare_impl() Oct 23 00:42:59.211568 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 23 00:42:59.211568 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application self.session.flush() Oct 23 00:42:59.211568 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 23 00:42:59.211568 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application self._flush(objects) Oct 23 00:42:59.211568 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 23 00:42:59.211568 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 23 00:42:59.211568 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 23 00:42:59.211568 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application compat.raise_( Oct 23 00:42:59.211568 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 00:42:59.211568 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception Oct 23 00:42:59.211568 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 23 00:42:59.211568 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application flush_context.execute() Oct 23 00:42:59.211568 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 23 00:42:59.211568 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rec.execute(self) Oct 23 00:42:59.211568 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 23 00:42:59.211568 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 23 00:42:59.212449 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 23 00:42:59.212449 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 23 00:42:59.212449 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 23 00:42:59.212449 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 23 00:42:59.212449 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 23 00:42:59.212449 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 23 00:42:59.212449 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 23 00:42:59.212449 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 23 00:42:59.212449 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 23 00:42:59.212449 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 23 00:42:59.212449 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 23 00:42:59.212449 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 23 00:42:59.212449 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 23 00:42:59.212449 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 23 00:42:59.212449 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 00:42:59.212449 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception Oct 23 00:42:59.213241 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 23 00:42:59.213241 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 23 00:42:59.213241 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 23 00:42:59.213241 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 23 00:42:59.213241 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 23 00:42:59.213241 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application result = self._query(query) Oct 23 00:42:59.213241 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 23 00:42:59.213241 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application conn.query(q) Oct 23 00:42:59.213241 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 23 00:42:59.213241 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 23 00:42:59.213241 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 23 00:42:59.213241 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application result.read() Oct 23 00:42:59.213241 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 23 00:42:59.213241 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 23 00:42:59.213241 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 23 00:42:59.213241 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 23 00:42:59.214006 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 23 00:42:59.214006 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 23 00:42:59.214006 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 23 00:42:59.214006 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 23 00:42:59.214006 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 23 00:42:59.214006 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 23 00:42:59.214006 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [parameters: {'id': 'eefbd74d3a4e4c97966d49e0fda7cc9d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 23 00:42:59.214006 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 23 00:42:59.214006 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:42:59.214006 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:42:59.214006 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:42:59.214006 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:42:59.214006 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:42:59.214006 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:42:59.214006 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:42:59.214006 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:42:59.216109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:42:59.216109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:42:59.216109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:42:59.216109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:42:59.216109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:42:59.216109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:42:59.216109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 23 00:42:59.216109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 23 00:42:59.216109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:42:59.216109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:42:59.216109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 23 00:42:59.216109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 23 00:42:59.216109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 23 00:42:59.216109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 23 00:42:59.216109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 23 00:42:59.216109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:42:59.219729 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 189/359] 10.222.0.23 () {60 vars in 1131 bytes} [Sun Oct 23 00:42:58 2022] POST /identity/v3/roles => generated 144 bytes in 243 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:42:59.226429 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d3c98-bb9b-48fe-a9cc-46483287eafa None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:59.265866 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:59.348182 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d3c98-bb9b-48fe-a9cc-46483287eafa None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:59.386252 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b262f35-0b9f-4b56-b641-1b22e6777428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:59.386933 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b262f35-0b9f-4b56-b641-1b22e6777428 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:59.387218 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b262f35-0b9f-4b56-b641-1b22e6777428 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:59.387489 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b262f35-0b9f-4b56-b641-1b22e6777428 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:59.397717 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b262f35-0b9f-4b56-b641-1b22e6777428 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:42:59.403151 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-4b262f35-0b9f-4b56-b641-1b22e6777428 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 00:42:59.403151 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:42:59.403151 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:42:59.403151 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:42:59.403151 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:42:59.403151 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:42:59.403151 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:42:59.403151 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:42:59.403151 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:42:59.403151 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:42:59.403151 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:42:59.403151 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:42:59.403151 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:42:59.403151 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:42:59.403151 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:42:59.403151 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:42:59.404031 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:42:59.404031 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:42:59.404031 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:42:59.404031 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:42:59.404031 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:42:59.404031 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:42:59.404031 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:42:59.404031 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:42:59.404031 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:42:59.404031 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:42:59.404031 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:42:59.404031 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:42:59.404031 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:42:59.404031 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:42:59.404031 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:42:59.404031 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:42:59.404877 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:42:59.404877 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:42:59.404877 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:42:59.404877 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:42:59.404877 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:42:59.404877 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:42:59.404877 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:42:59.404877 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:42:59.404877 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:42:59.404877 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:42:59.404877 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 23 00:42:59.404877 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:42:59.404877 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 171/360] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 23 00:42:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:42:59.410144 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b0cc1-3979-49e3-9fc2-9d4ba654bc8c None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:42:59.453693 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:42:59.526144 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b0cc1-3979-49e3-9fc2-9d4ba654bc8c None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:42:59.571578 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e156f1db-40b4-4549-b233-2dda953fabb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:42:59.572554 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156f1db-40b4-4549-b233-2dda953fabb0 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:42:59.573048 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156f1db-40b4-4549-b233-2dda953fabb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:42:59.573526 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156f1db-40b4-4549-b233-2dda953fabb0 None admin] PATH_INFO: `/v3/roles` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:42:59.574413 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e156f1db-40b4-4549-b233-2dda953fabb0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:42:59.574944 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e156f1db-40b4-4549-b233-2dda953fabb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:42:59.576533 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e156f1db-40b4-4549-b233-2dda953fabb0 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:42:59.588343 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 190/361] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 23 00:42:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:43:00.593736 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47f1a7-e07f-4e18-9747-7ac6ab3bfc8d None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:00.594759 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47f1a7-e07f-4e18-9747-7ac6ab3bfc8d None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:00.595235 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47f1a7-e07f-4e18-9747-7ac6ab3bfc8d None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:00.596990 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 172/362] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:43:00.602635 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd8cbb-cd3c-4e36-8ec9-dc704215cdb5 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:00.603437 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd8cbb-cd3c-4e36-8ec9-dc704215cdb5 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:00.603908 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd8cbb-cd3c-4e36-8ec9-dc704215cdb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:00.623085 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-1bdd8cbb-cd3c-4e36-8ec9-dc704215cdb5 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:00.624561 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-1bdd8cbb-cd3c-4e36-8ec9-dc704215cdb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:00.708118 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 191/363] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:43:00.993871 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b47f1a7-e07f-4e18-9747-7ac6ab3bfc8d None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:01.008446 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69cf3d-1fb7-4562-bc75-a954c31c705e None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:01.009071 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69cf3d-1fb7-4562-bc75-a954c31c705e None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:01.009548 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69cf3d-1fb7-4562-bc75-a954c31c705e None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:01.012592 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 192/364] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:43:01.016399 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d38e1f-6c30-464c-85ab-1e7b14d4032c None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:01.016893 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d38e1f-6c30-464c-85ab-1e7b14d4032c None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:01.017359 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d38e1f-6c30-464c-85ab-1e7b14d4032c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:01.049094 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-b8d38e1f-6c30-464c-85ab-1e7b14d4032c None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:01.051283 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-b8d38e1f-6c30-464c-85ab-1e7b14d4032c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:01.086807 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:01.154457 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:01.172583 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 193/365] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:43:01.180189 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b47f1a7-e07f-4e18-9747-7ac6ab3bfc8d None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:01.218877 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f0d0c-aadf-4f73-bade-6faddcc4c1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:01.219536 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f0d0c-aadf-4f73-bade-6faddcc4c1f8 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:01.219822 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f0d0c-aadf-4f73-bade-6faddcc4c1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:01.220095 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f0d0c-aadf-4f73-bade-6faddcc4c1f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:01.231750 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f0d0c-aadf-4f73-bade-6faddcc4c1f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:43:01.236944 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-512f0d0c-aadf-4f73-bade-6faddcc4c1f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:43:01.236944 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:01.236944 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:01.236944 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:01.236944 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:01.236944 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:01.236944 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:01.236944 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:01.236944 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:01.236944 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:01.236944 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:01.236944 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:01.236944 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:43:01.236944 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:43:01.236944 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:43:01.236944 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:43:01.237983 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:43:01.237983 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:43:01.237983 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:43:01.237983 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:43:01.237983 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:01.237983 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:01.237983 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:01.237983 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:01.237983 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:01.237983 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:01.237983 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:01.237983 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:01.237983 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:01.237983 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:01.237983 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:01.237983 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:01.239041 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:01.239041 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:01.239041 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:01.239041 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:01.239041 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:43:01.239041 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:43:01.239041 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:43:01.239041 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:43:01.239041 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:43:01.239041 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:43:01.239041 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:43:01.239041 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:01.241357 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 173/366] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 23 00:43:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:01.249516 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d38e1f-6c30-464c-85ab-1e7b14d4032c None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:01.354807 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d38e1f-6c30-464c-85ab-1e7b14d4032c None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:01.389233 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838fc410-70c8-45bd-8587-5fa5932b3c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:01.389843 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838fc410-70c8-45bd-8587-5fa5932b3c3f None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:01.390146 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838fc410-70c8-45bd-8587-5fa5932b3c3f None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:01.390481 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838fc410-70c8-45bd-8587-5fa5932b3c3f None admin] PATH_INFO: `/v3/roles` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:01.391143 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838fc410-70c8-45bd-8587-5fa5932b3c3f None admin] RBAC: Adding query filter params (name=service) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:01.391445 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838fc410-70c8-45bd-8587-5fa5932b3c3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:01.393203 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838fc410-70c8-45bd-8587-5fa5932b3c3f None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:01.402416 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 194/367] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Oct 23 00:43:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:01.411770 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f0d0c-aadf-4f73-bade-6faddcc4c1f8 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:01.538317 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f0d0c-aadf-4f73-bade-6faddcc4c1f8 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:01.575332 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8465ff-ccd5-4cf3-86cd-bd04fc7018c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:01.576396 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8465ff-ccd5-4cf3-86cd-bd04fc7018c6 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:01.576885 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8465ff-ccd5-4cf3-86cd-bd04fc7018c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:01.577357 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8465ff-ccd5-4cf3-86cd-bd04fc7018c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:01.590798 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8465ff-ccd5-4cf3-86cd-bd04fc7018c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:01.592754 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8465ff-ccd5-4cf3-86cd-bd04fc7018c6 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:01.594910 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:01.611100 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-5c8465ff-ccd5-4cf3-86cd-bd04fc7018c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:01.611100 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:01.611100 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:01.611100 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:01.611100 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:01.611100 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:01.611100 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:01.611100 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:01.611100 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:01.611100 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:01.611100 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:01.611100 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:01.611100 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:43:01.611100 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:43:01.611100 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:43:01.611100 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:43:01.612058 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:01.612058 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:01.612058 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:01.612058 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:01.612058 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:01.612058 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:01.612058 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:01.612058 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:01.612058 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:01.612058 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:01.612058 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:01.612058 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:01.612058 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:01.612058 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:01.612058 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:01.612058 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:01.612058 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:43:01.612899 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:43:01.612899 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:01.612899 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:01.614752 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 174/368] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:43:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:01.620477 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838fc410-70c8-45bd-8587-5fa5932b3c3f None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:01.641599 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8465ff-ccd5-4cf3-86cd-bd04fc7018c6 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:01.661042 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:01.757731 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838fc410-70c8-45bd-8587-5fa5932b3c3f None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:01.780480 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8465ff-ccd5-4cf3-86cd-bd04fc7018c6 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:01.804266 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5a456-585c-4c59-b4c1-64e7dcda459b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:01.805786 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5a456-585c-4c59-b4c1-64e7dcda459b None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:01.806436 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5a456-585c-4c59-b4c1-64e7dcda459b None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:01.806719 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5a456-585c-4c59-b4c1-64e7dcda459b None admin] PATH_INFO: `/v3/domains` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:01.807377 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5a456-585c-4c59-b4c1-64e7dcda459b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:01.807682 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5a456-585c-4c59-b4c1-64e7dcda459b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:01.809082 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5a456-585c-4c59-b4c1-64e7dcda459b None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:01.821735 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 195/369] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:01.823015 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bfaea-61cf-449f-b2b5-27d9a7ab10d5 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:01.823299 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bfaea-61cf-449f-b2b5-27d9a7ab10d5 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:01.823571 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bfaea-61cf-449f-b2b5-27d9a7ab10d5 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:01.828622 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 196/370] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:43:01.828622 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cf656-008d-4050-b167-7451ad0bd2cd None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:01.828622 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cf656-008d-4050-b167-7451ad0bd2cd None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:01.828622 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cf656-008d-4050-b167-7451ad0bd2cd None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:01.828622 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 197/371] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:43:01.828979 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038cf656-008d-4050-b167-7451ad0bd2cd None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:01.831243 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7ca72-8734-4b95-9731-4ad651cedc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:01.832099 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7ca72-8734-4b95-9731-4ad651cedc35 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:01.833250 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7ca72-8734-4b95-9731-4ad651cedc35 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:01.833698 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7ca72-8734-4b95-9731-4ad651cedc35 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:01.844036 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d7ca72-8734-4b95-9731-4ad651cedc35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:43:01.849319 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-76d7ca72-8734-4b95-9731-4ad651cedc35 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:43:01.849319 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:01.849319 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:01.849319 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:01.849319 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:01.849319 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:01.849319 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:01.849319 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:01.849319 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:01.849319 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:01.849319 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:01.849319 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:01.849319 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:43:01.849319 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:43:01.849319 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:43:01.849319 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:43:01.850448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:43:01.850448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:43:01.850448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:43:01.850448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:43:01.850448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:01.850448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:01.850448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:01.850448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:01.850448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:01.850448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:01.850448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:01.850448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:01.850448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:01.850448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:01.850448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:01.850448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:01.851225 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:01.851225 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:01.851225 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:01.851225 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:01.851225 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:43:01.851225 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:43:01.851225 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:43:01.851225 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:43:01.851225 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:43:01.851225 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:43:01.851225 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:43:01.851225 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:01.851225 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 175/372] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 23 00:43:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:43:01.851862 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac674ca-9589-4f84-bb88-a7393517e370 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:01.852225 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac674ca-9589-4f84-bb88-a7393517e370 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:01.852415 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac674ca-9589-4f84-bb88-a7393517e370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:01.871447 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-1ac674ca-9589-4f84-bb88-a7393517e370 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:01.873062 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-1ac674ca-9589-4f84-bb88-a7393517e370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:01.915505 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:01.928281 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:01.936188 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038cf656-008d-4050-b167-7451ad0bd2cd None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:01.954487 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 176/373] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:43:01.954487 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4933c-f56a-4c9c-93b8-08311bd338af None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:01.954487 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4933c-f56a-4c9c-93b8-08311bd338af None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:01.954487 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4933c-f56a-4c9c-93b8-08311bd338af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:01.967141 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-3bb4933c-f56a-4c9c-93b8-08311bd338af None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:01.968325 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-3bb4933c-f56a-4c9c-93b8-08311bd338af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:01.979819 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102ddc3-a9e8-4bef-8e25-e2334057bdbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:01.980446 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102ddc3-a9e8-4bef-8e25-e2334057bdbe None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:01.980986 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102ddc3-a9e8-4bef-8e25-e2334057bdbe None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:01.981251 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102ddc3-a9e8-4bef-8e25-e2334057bdbe None admin] PATH_INFO: `/v3/users/glance` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:01.992713 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8102ddc3-a9e8-4bef-8e25-e2334057bdbe None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:01.994498 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8102ddc3-a9e8-4bef-8e25-e2334057bdbe None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:02.012430 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-8102ddc3-a9e8-4bef-8e25-e2334057bdbe None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 23 00:43:02.012430 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:02.012430 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:02.012430 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:02.012430 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:02.012430 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:02.012430 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:02.012430 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:02.012430 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:02.012430 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:02.012430 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:02.012430 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:02.012430 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 00:43:02.012430 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 00:43:02.012430 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 00:43:02.012430 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 00:43:02.013368 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:02.013368 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:02.013368 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:43:02.013368 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:43:02.013368 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:43:02.013368 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:43:02.013368 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:02.013368 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:02.013368 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:02.013368 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:02.013368 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:02.013368 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:02.013368 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:02.013368 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:02.013368 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:02.013368 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:02.013368 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:02.013368 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:02.014282 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:02.014282 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:02.014282 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 00:43:02.014282 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 00:43:02.014282 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 00:43:02.014282 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 00:43:02.014282 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 00:43:02.014282 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 00:43:02.014282 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 23 00:43:02.014282 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:02.014282 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 198/374] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 23 00:43:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:02.014867 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102ddc3-a9e8-4bef-8e25-e2334057bdbe None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:02.044202 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 177/375] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:43:02.044876 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4933c-f56a-4c9c-93b8-08311bd338af None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:02.181221 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102ddc3-a9e8-4bef-8e25-e2334057bdbe None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:02.204386 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4933c-f56a-4c9c-93b8-08311bd338af None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:02.232923 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:02.245785 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b3f93-cf8f-4a7d-97bc-6a9de86122e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:02.246438 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b3f93-cf8f-4a7d-97bc-6a9de86122e9 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:02.246713 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b3f93-cf8f-4a7d-97bc-6a9de86122e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:02.246983 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b3f93-cf8f-4a7d-97bc-6a9de86122e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:02.247648 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592b3f93-cf8f-4a7d-97bc-6a9de86122e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:02.247949 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592b3f93-cf8f-4a7d-97bc-6a9de86122e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:02.249343 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592b3f93-cf8f-4a7d-97bc-6a9de86122e9 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:02.265574 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 199/376] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Oct 23 00:43:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:02.271450 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b3f93-cf8f-4a7d-97bc-6a9de86122e9 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:02.274737 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc8ee5-1820-4df9-ba03-10f0e06bd369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:02.275347 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc8ee5-1820-4df9-ba03-10f0e06bd369 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:02.275620 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc8ee5-1820-4df9-ba03-10f0e06bd369 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:02.275888 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc8ee5-1820-4df9-ba03-10f0e06bd369 None admin] PATH_INFO: `/v3/users` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:02.276635 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc8ee5-1820-4df9-ba03-10f0e06bd369 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:02.276923 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc8ee5-1820-4df9-ba03-10f0e06bd369 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:02.278386 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc8ee5-1820-4df9-ba03-10f0e06bd369 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:02.281876 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:02.326172 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 178/377] 10.222.0.23 () {56 vars in 1137 bytes} [Sun Oct 23 00:43:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:02.327131 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc8ee5-1820-4df9-ba03-10f0e06bd369 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:02.386546 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b3f93-cf8f-4a7d-97bc-6a9de86122e9 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:02.422019 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac50c07-76bf-4e90-bbef-55ef7bec5ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:02.422677 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac50c07-76bf-4e90-bbef-55ef7bec5ad1 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:02.422958 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac50c07-76bf-4e90-bbef-55ef7bec5ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:02.423224 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac50c07-76bf-4e90-bbef-55ef7bec5ad1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:02.436554 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac50c07-76bf-4e90-bbef-55ef7bec5ad1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:02.437934 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac50c07-76bf-4e90-bbef-55ef7bec5ad1 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:02.443385 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc8ee5-1820-4df9-ba03-10f0e06bd369 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:02.452454 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-7ac50c07-76bf-4e90-bbef-55ef7bec5ad1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:02.452454 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:02.452454 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:02.452454 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:02.452454 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:02.452454 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:02.452454 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:02.452454 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:02.452454 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:02.452454 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:02.452454 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:02.452454 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:02.452454 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:43:02.452454 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:43:02.452454 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:43:02.452454 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:43:02.453424 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:02.453424 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:02.453424 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:02.453424 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:02.453424 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:02.453424 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:02.453424 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:02.453424 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:02.453424 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:02.453424 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:02.453424 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:02.453424 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:02.453424 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:02.453424 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:02.453424 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:02.453424 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:02.453424 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:43:02.454299 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:43:02.454299 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:02.454299 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:02.454299 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 200/378] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:43:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:02.454531 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac50c07-76bf-4e90-bbef-55ef7bec5ad1 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:02.485238 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18f271-5acb-46f1-8956-b693197d84a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:02.485891 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18f271-5acb-46f1-8956-b693197d84a9 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:02.486203 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18f271-5acb-46f1-8956-b693197d84a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:02.486482 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18f271-5acb-46f1-8956-b693197d84a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:02.500017 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c18f271-5acb-46f1-8956-b693197d84a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:43:02.506464 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-5c18f271-5acb-46f1-8956-b693197d84a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:43:02.506464 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:02.506464 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:02.506464 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:02.506464 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:02.506464 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:02.506464 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:02.506464 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:02.506464 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:02.506464 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:02.506464 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:02.506464 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:02.506464 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:43:02.506464 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:43:02.506464 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:43:02.506464 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:43:02.507440 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:43:02.507440 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:43:02.507440 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:43:02.507440 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:43:02.507440 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:02.507440 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:02.507440 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:02.507440 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:02.507440 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:02.507440 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:02.507440 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:02.507440 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:02.507440 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:02.507440 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:02.507440 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:02.507440 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:02.508855 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:02.508855 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:02.508855 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:02.508855 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:02.508855 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:43:02.508855 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:43:02.508855 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:43:02.508855 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:43:02.508855 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:43:02.508855 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:43:02.508855 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:43:02.508855 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:02.508855 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 179/379] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 23 00:43:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:02.508855 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18f271-5acb-46f1-8956-b693197d84a9 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:02.530942 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:02.542933 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:02.581707 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac50c07-76bf-4e90-bbef-55ef7bec5ad1 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:02.617546 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa19ab-d698-4486-8b65-b2979daf17c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:02.618210 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa19ab-d698-4486-8b65-b2979daf17c9 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:02.618333 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18f271-5acb-46f1-8956-b693197d84a9 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:02.618759 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa19ab-d698-4486-8b65-b2979daf17c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:02.618759 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa19ab-d698-4486-8b65-b2979daf17c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:02.630621 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa19ab-d698-4486-8b65-b2979daf17c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:02.632079 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa19ab-d698-4486-8b65-b2979daf17c9 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:02.646016 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-0daa19ab-d698-4486-8b65-b2979daf17c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:02.646016 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:02.646016 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:02.646016 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:02.646016 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:02.646016 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:02.646016 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:02.646016 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:02.646016 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:02.646016 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:02.646016 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:02.646016 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:02.646016 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:43:02.646016 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:43:02.646016 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:43:02.646016 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:43:02.646917 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:02.646917 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:02.646917 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:02.646917 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:02.646917 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:02.646917 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:02.646917 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:02.646917 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:02.646917 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:02.646917 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:02.646917 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:02.646917 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:02.646917 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:02.646917 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:02.646917 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:02.646917 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:02.646917 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:43:02.647735 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:43:02.647735 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:02.647735 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:02.647735 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 201/380] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:43:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:02.647950 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa19ab-d698-4486-8b65-b2979daf17c9 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:02.656690 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae11e73-df78-4344-822b-ea8ef10ad2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:02.657314 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae11e73-df78-4344-822b-ea8ef10ad2f4 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:02.657608 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae11e73-df78-4344-822b-ea8ef10ad2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:02.657861 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae11e73-df78-4344-822b-ea8ef10ad2f4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:02.668050 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae11e73-df78-4344-822b-ea8ef10ad2f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:43:02.672874 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-dae11e73-df78-4344-822b-ea8ef10ad2f4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:43:02.672874 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:02.672874 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:02.672874 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:02.672874 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:02.672874 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:02.672874 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:02.672874 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:02.672874 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:02.672874 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:02.672874 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:02.672874 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:02.672874 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:43:02.672874 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:43:02.672874 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:43:02.672874 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:43:02.673802 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:43:02.673802 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:43:02.673802 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:43:02.673802 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:43:02.673802 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:02.673802 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:02.673802 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:02.673802 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:02.673802 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:02.673802 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:02.673802 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:02.673802 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:02.673802 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:02.673802 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:02.673802 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:02.673802 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:02.674744 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:02.674744 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:02.674744 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:02.674744 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:02.674744 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:43:02.674744 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:43:02.674744 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:43:02.674744 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:43:02.674744 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:43:02.674744 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:43:02.674744 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:43:02.674744 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:02.674744 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 180/381] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 23 00:43:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:02.675395 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae11e73-df78-4344-822b-ea8ef10ad2f4 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:02.750112 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa19ab-d698-4486-8b65-b2979daf17c9 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:02.759150 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:02.764635 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:02.773401 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae11e73-df78-4344-822b-ea8ef10ad2f4 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:02.783650 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0bfdb-913b-4664-bfd0-db6ff792ef0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:02.784244 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0bfdb-913b-4664-bfd0-db6ff792ef0a None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:02.784520 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0bfdb-913b-4664-bfd0-db6ff792ef0a None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:02.784786 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0bfdb-913b-4664-bfd0-db6ff792ef0a None admin] PATH_INFO: `/v3/domains` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:02.785416 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0bfdb-913b-4664-bfd0-db6ff792ef0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:02.785710 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0bfdb-913b-4664-bfd0-db6ff792ef0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:02.787115 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0bfdb-913b-4664-bfd0-db6ff792ef0a None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:02.799182 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 202/382] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:43:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:02.800330 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4f99d-d125-4fe9-89f3-f7be2fb63390 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:02.800608 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4f99d-d125-4fe9-89f3-f7be2fb63390 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:02.800877 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4f99d-d125-4fe9-89f3-f7be2fb63390 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:02.806358 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 203/383] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:43:02.806358 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4f99d-d125-4fe9-89f3-f7be2fb63390 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:02.812291 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2961f-bd48-46ce-8bba-16e229b5bbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:02.812896 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2961f-bd48-46ce-8bba-16e229b5bbb7 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:02.813174 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2961f-bd48-46ce-8bba-16e229b5bbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:02.813790 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2961f-bd48-46ce-8bba-16e229b5bbb7 None admin] PATH_INFO: `/v3/roles` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:02.814525 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a2961f-bd48-46ce-8bba-16e229b5bbb7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:02.815121 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a2961f-bd48-46ce-8bba-16e229b5bbb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:02.816508 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a2961f-bd48-46ce-8bba-16e229b5bbb7 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:02.825060 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 181/384] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Oct 23 00:43:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:02.825921 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2961f-bd48-46ce-8bba-16e229b5bbb7 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:02.903298 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4f99d-d125-4fe9-89f3-f7be2fb63390 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:02.924201 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2961f-bd48-46ce-8bba-16e229b5bbb7 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:02.937339 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c6cbe-3fef-4452-a0c4-8fa20215faaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:02.937942 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c6cbe-3fef-4452-a0c4-8fa20215faaf None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:02.938248 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c6cbe-3fef-4452-a0c4-8fa20215faaf None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:02.938516 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c6cbe-3fef-4452-a0c4-8fa20215faaf None admin] PATH_INFO: `/v3/domains` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:02.939151 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0c6cbe-3fef-4452-a0c4-8fa20215faaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:02.939450 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0c6cbe-3fef-4452-a0c4-8fa20215faaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:02.940835 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0c6cbe-3fef-4452-a0c4-8fa20215faaf None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:02.952385 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 204/385] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:43:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:02.953158 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c6cbe-3fef-4452-a0c4-8fa20215faaf None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:02.962118 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f0a9d-afa6-4b6a-80da-0b94e752577c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:02.962712 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f0a9d-afa6-4b6a-80da-0b94e752577c None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:02.962998 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f0a9d-afa6-4b6a-80da-0b94e752577c None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:02.963263 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f0a9d-afa6-4b6a-80da-0b94e752577c None admin] PATH_INFO: `/v3/roles` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:02.963927 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f0a9d-afa6-4b6a-80da-0b94e752577c None admin] RBAC: Adding query filter params (name=service) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:02.964224 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f0a9d-afa6-4b6a-80da-0b94e752577c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:02.965602 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f0a9d-afa6-4b6a-80da-0b94e752577c None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:02.973403 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 182/386] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Oct 23 00:43:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:02.974555 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d1125-5ccf-4586-9446-6b30261cc667 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:02.974838 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d1125-5ccf-4586-9446-6b30261cc667 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:02.975108 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d1125-5ccf-4586-9446-6b30261cc667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:02.984994 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:02.993863 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-a53d1125-5ccf-4586-9446-6b30261cc667 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:02.995079 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-a53d1125-5ccf-4586-9446-6b30261cc667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:03.005969 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:03.058659 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c6cbe-3fef-4452-a0c4-8fa20215faaf None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:03.059886 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 183/387] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:43:03.061663 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d1125-5ccf-4586-9446-6b30261cc667 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:03.095577 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a6342b-5c71-478b-bb9b-0d36294de0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:03.096198 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6342b-5c71-478b-bb9b-0d36294de0bb None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:03.096476 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6342b-5c71-478b-bb9b-0d36294de0bb None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:03.096852 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6342b-5c71-478b-bb9b-0d36294de0bb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:03.104850 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a6342b-5c71-478b-bb9b-0d36294de0bb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:03.106590 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a6342b-5c71-478b-bb9b-0d36294de0bb None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:03.118657 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-39a6342b-5c71-478b-bb9b-0d36294de0bb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 23 00:43:03.118657 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:03.118657 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:03.118657 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:03.118657 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:03.118657 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:03.118657 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:03.118657 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:03.118657 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:03.118657 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:03.118657 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:03.118657 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:03.118657 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 00:43:03.118657 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 00:43:03.118657 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 00:43:03.118657 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 00:43:03.119752 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:03.119752 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:03.119752 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:43:03.119752 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:43:03.119752 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:43:03.119752 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:43:03.119752 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:03.119752 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:03.119752 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:03.119752 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:03.119752 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:03.119752 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:03.119752 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:03.119752 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:03.119752 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:03.119752 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:03.119752 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:03.119752 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:03.120959 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:03.120959 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:03.120959 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 00:43:03.120959 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 00:43:03.120959 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 00:43:03.120959 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 00:43:03.120959 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 00:43:03.120959 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 00:43:03.120959 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 23 00:43:03.120959 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:03.124399 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 205/388] 10.222.0.23 () {56 vars in 1093 bytes} [Sun Oct 23 00:43:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:03.125219 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a6342b-5c71-478b-bb9b-0d36294de0bb None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:03.167558 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d1125-5ccf-4586-9446-6b30261cc667 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:03.210870 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64550ce7-8a97-4704-a5ab-02fec5ed8ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:03.211540 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64550ce7-8a97-4704-a5ab-02fec5ed8ba9 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:03.211940 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64550ce7-8a97-4704-a5ab-02fec5ed8ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:03.212270 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64550ce7-8a97-4704-a5ab-02fec5ed8ba9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:03.218019 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:03.227221 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64550ce7-8a97-4704-a5ab-02fec5ed8ba9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:03.228685 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64550ce7-8a97-4704-a5ab-02fec5ed8ba9 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:03.233133 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a6342b-5c71-478b-bb9b-0d36294de0bb None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:03.236204 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:03.245448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-64550ce7-8a97-4704-a5ab-02fec5ed8ba9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:03.245448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:03.245448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:03.245448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:03.245448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:03.245448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:03.245448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:03.245448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:03.245448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:03.245448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:03.245448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:03.245448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:03.245448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:43:03.245448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:43:03.245448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:43:03.245448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:43:03.251448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:03.251448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:03.251448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:03.251448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:03.251448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:03.251448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:03.251448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:03.251448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:03.251448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:03.251448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:03.251448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:03.251448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:03.251448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:03.251448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:03.251448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:03.251448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:03.251448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:43:03.252354 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:43:03.252354 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:03.252354 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:03.252354 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 184/389] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:43:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:03.252354 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64550ce7-8a97-4704-a5ab-02fec5ed8ba9 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:03.275442 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91e494-0869-40b9-b351-25dcf41460a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:03.275991 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91e494-0869-40b9-b351-25dcf41460a2 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:03.276277 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91e494-0869-40b9-b351-25dcf41460a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:03.276555 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91e494-0869-40b9-b351-25dcf41460a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:03.283318 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff91e494-0869-40b9-b351-25dcf41460a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:03.285073 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff91e494-0869-40b9-b351-25dcf41460a2 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:03.297383 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-ff91e494-0869-40b9-b351-25dcf41460a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:43:03.297383 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:03.297383 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:03.297383 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:03.297383 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:03.297383 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:03.297383 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:03.297383 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:03.297383 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:03.297383 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:03.297383 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:03.297383 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:03.297383 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 00:43:03.297383 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 00:43:03.297383 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 00:43:03.298310 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 00:43:03.298310 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:03.298310 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:03.298310 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:03.298310 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:03.298310 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:03.298310 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:03.298310 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:03.298310 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:03.298310 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:03.298310 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:03.298310 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:03.298310 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:03.298310 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:03.298310 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:03.298310 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:03.298310 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:03.299177 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 00:43:03.299177 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 00:43:03.299177 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 00:43:03.299177 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 00:43:03.299177 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 00:43:03.299177 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 00:43:03.299177 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:43:03.299177 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:03.299177 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 206/390] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 23 00:43:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:03.299669 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91e494-0869-40b9-b351-25dcf41460a2 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:03.358551 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64550ce7-8a97-4704-a5ab-02fec5ed8ba9 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:03.392728 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7469eba-7640-4f0f-9b74-1c66d459215c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:03.393348 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7469eba-7640-4f0f-9b74-1c66d459215c None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:03.393637 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7469eba-7640-4f0f-9b74-1c66d459215c None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:03.393910 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7469eba-7640-4f0f-9b74-1c66d459215c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:03.399756 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91e494-0869-40b9-b351-25dcf41460a2 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:03.404660 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7469eba-7640-4f0f-9b74-1c66d459215c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:03.406124 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7469eba-7640-4f0f-9b74-1c66d459215c None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:03.420625 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-c7469eba-7640-4f0f-9b74-1c66d459215c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:03.420625 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:03.420625 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:03.420625 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:03.420625 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:03.420625 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:03.420625 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:03.420625 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:03.420625 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:03.420625 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:03.420625 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:03.420625 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:03.420625 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:43:03.420625 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:43:03.420625 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:43:03.420625 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:43:03.421714 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:03.421714 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:03.421714 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:03.421714 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:03.421714 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:03.421714 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:03.421714 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:03.421714 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:03.421714 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:03.421714 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:03.421714 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:03.421714 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:03.421714 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:03.421714 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:03.421714 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:03.421714 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:03.421714 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:43:03.422798 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:43:03.422798 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:03.422798 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:03.422798 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 185/391] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:43:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:03.422798 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7469eba-7640-4f0f-9b74-1c66d459215c None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:03.439314 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ffc7bb-c306-4cbb-8221-1ddb947174b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:03.439923 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffc7bb-c306-4cbb-8221-1ddb947174b1 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:03.440200 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffc7bb-c306-4cbb-8221-1ddb947174b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:03.440471 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffc7bb-c306-4cbb-8221-1ddb947174b1 None admin] PATH_INFO: `/v3/users` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:03.441197 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ffc7bb-c306-4cbb-8221-1ddb947174b1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:03.441499 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ffc7bb-c306-4cbb-8221-1ddb947174b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:03.442982 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ffc7bb-c306-4cbb-8221-1ddb947174b1 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:03.470265 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:03.480930 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 207/392] 10.222.0.23 () {56 vars in 1133 bytes} [Sun Oct 23 00:43:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:03.481753 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ffc7bb-c306-4cbb-8221-1ddb947174b1 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:03.490187 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:03.525854 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7469eba-7640-4f0f-9b74-1c66d459215c None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:03.560965 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2fe86-b2b9-45a0-9823-26948070d202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:03.561566 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2fe86-b2b9-45a0-9823-26948070d202 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:03.561850 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2fe86-b2b9-45a0-9823-26948070d202 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:03.562154 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2fe86-b2b9-45a0-9823-26948070d202 None admin] PATH_INFO: `/v3/domains` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:03.562790 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2fe86-b2b9-45a0-9823-26948070d202 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:03.563087 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2fe86-b2b9-45a0-9823-26948070d202 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:03.564453 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2fe86-b2b9-45a0-9823-26948070d202 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:03.575755 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 186/393] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:43:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:03.576532 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2fe86-b2b9-45a0-9823-26948070d202 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:03.584378 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ffc7bb-c306-4cbb-8221-1ddb947174b1 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:03.618753 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745e020-b7cb-4a38-aeb3-fcf44bc8f23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:03.619360 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745e020-b7cb-4a38-aeb3-fcf44bc8f23a None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:03.619641 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745e020-b7cb-4a38-aeb3-fcf44bc8f23a None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:03.619913 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745e020-b7cb-4a38-aeb3-fcf44bc8f23a None admin] PATH_INFO: `/v3/projects` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:03.620603 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e745e020-b7cb-4a38-aeb3-fcf44bc8f23a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:03.620905 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e745e020-b7cb-4a38-aeb3-fcf44bc8f23a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:03.622380 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e745e020-b7cb-4a38-aeb3-fcf44bc8f23a None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:03.639392 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 208/394] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 23 00:43:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:03.640182 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745e020-b7cb-4a38-aeb3-fcf44bc8f23a None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:03.677616 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2fe86-b2b9-45a0-9823-26948070d202 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:03.689980 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:03.704771 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:03.713206 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f30ce-5356-44fb-aced-b370c4ec3466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:03.713840 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f30ce-5356-44fb-aced-b370c4ec3466 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:03.714146 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f30ce-5356-44fb-aced-b370c4ec3466 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:03.714424 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f30ce-5356-44fb-aced-b370c4ec3466 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:03.724918 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f30ce-5356-44fb-aced-b370c4ec3466 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:03.726421 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f30ce-5356-44fb-aced-b370c4ec3466 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:03.740708 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745e020-b7cb-4a38-aeb3-fcf44bc8f23a None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:03.740849 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-ba8f30ce-5356-44fb-aced-b370c4ec3466 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:03.740849 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:03.740849 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:03.740849 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:03.740849 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:03.740849 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:03.740849 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:03.740849 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:03.740849 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:03.740849 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:03.740849 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:03.740849 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:03.740849 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:43:03.740849 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:43:03.740849 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:43:03.740849 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:43:03.741763 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:03.741763 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:03.741763 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:03.741763 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:03.741763 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:03.741763 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:03.741763 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:03.741763 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:03.741763 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:03.741763 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:03.741763 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:03.741763 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:03.741763 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:03.741763 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:03.741763 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:03.741763 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:03.741763 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:43:03.747362 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:43:03.747362 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:03.747362 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:03.747362 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 187/395] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:43:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:03.747362 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f30ce-5356-44fb-aced-b370c4ec3466 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:03.776265 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe8bf7-166a-463b-b0a6-4a9aab404179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:03.776897 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe8bf7-166a-463b-b0a6-4a9aab404179 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:03.777245 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe8bf7-166a-463b-b0a6-4a9aab404179 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:03.777616 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe8bf7-166a-463b-b0a6-4a9aab404179 None admin] PATH_INFO: `/v3/domains` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:03.778370 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fe8bf7-166a-463b-b0a6-4a9aab404179 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:03.778672 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fe8bf7-166a-463b-b0a6-4a9aab404179 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:03.780052 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fe8bf7-166a-463b-b0a6-4a9aab404179 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:03.790917 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 209/396] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:43:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:03.791694 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe8bf7-166a-463b-b0a6-4a9aab404179 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:03.841638 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f30ce-5356-44fb-aced-b370c4ec3466 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:03.875729 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a4a3e-d52c-4675-bfe3-5df21d915f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:03.876382 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a4a3e-d52c-4675-bfe3-5df21d915f45 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:03.876664 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a4a3e-d52c-4675-bfe3-5df21d915f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:03.876943 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a4a3e-d52c-4675-bfe3-5df21d915f45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:03.888151 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a4a3e-d52c-4675-bfe3-5df21d915f45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:03.889152 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe8bf7-166a-463b-b0a6-4a9aab404179 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:03.889589 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a4a3e-d52c-4675-bfe3-5df21d915f45 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:03.903960 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-b52a4a3e-d52c-4675-bfe3-5df21d915f45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:03.903960 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:03.903960 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:03.903960 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:03.903960 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:03.903960 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:03.903960 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:03.903960 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:03.903960 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:03.903960 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:03.903960 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:03.903960 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:03.903960 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:43:03.903960 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:43:03.903960 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:43:03.903960 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:43:03.904848 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:03.904848 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:03.904848 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:03.904848 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:03.904848 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:03.904848 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:03.904848 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:03.904848 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:03.904848 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:03.904848 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:03.904848 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:03.904848 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:03.904848 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:03.904848 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:03.904848 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:03.904848 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:03.904848 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:43:03.906388 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:43:03.906388 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:03.906388 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:03.906388 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 188/397] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:43:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:03.906388 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a4a3e-d52c-4675-bfe3-5df21d915f45 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:03.916418 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:03.923225 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:03.926569 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51512207-9bcc-48a2-9be8-0878eda522ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:03.927245 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51512207-9bcc-48a2-9be8-0878eda522ab None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:03.927527 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51512207-9bcc-48a2-9be8-0878eda522ab None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:03.927806 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51512207-9bcc-48a2-9be8-0878eda522ab None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:03.935331 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51512207-9bcc-48a2-9be8-0878eda522ab None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:03.936795 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51512207-9bcc-48a2-9be8-0878eda522ab None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:03.948280 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-51512207-9bcc-48a2-9be8-0878eda522ab None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 23 00:43:03.948280 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:03.948280 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:03.948280 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:03.948280 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:03.948280 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:03.948280 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:03.948280 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:03.948280 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:03.948280 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:03.948280 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:03.948280 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:03.948280 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 00:43:03.948280 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 00:43:03.948280 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 00:43:03.948280 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 00:43:03.949141 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:03.949141 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:03.949141 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:43:03.949141 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:43:03.949141 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:43:03.949141 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:43:03.949141 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:03.949141 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:03.949141 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:03.949141 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:03.949141 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:03.949141 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:03.949141 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:03.949141 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:03.949141 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:03.949141 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:03.949141 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:03.949141 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:03.950038 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:03.950038 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:03.950038 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 00:43:03.950038 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 00:43:03.950038 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 00:43:03.950038 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 00:43:03.950038 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 00:43:03.950038 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 00:43:03.950038 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 23 00:43:03.950038 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:03.950038 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 210/398] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 23 00:43:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:03.950641 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51512207-9bcc-48a2-9be8-0878eda522ab None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:04.011952 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a4a3e-d52c-4675-bfe3-5df21d915f45 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:04.044847 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d989059-02b5-46c2-a13d-331206a08568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:04.045437 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d989059-02b5-46c2-a13d-331206a08568 None admin] REQUEST_METHOD: `PUT` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:04.045720 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d989059-02b5-46c2-a13d-331206a08568 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:04.046002 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d989059-02b5-46c2-a13d-331206a08568 None admin] PATH_INFO: `/v3/projects/60f8594760e44ce3888a32702ea9afcc/users/1b94f1f12db3473f9ce1f33d2d9056a7/roles/832e4b25a75c4d30a010d6803a5a4577` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:04.048607 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51512207-9bcc-48a2-9be8-0878eda522ab None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:04.059835 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d989059-02b5-46c2-a13d-331206a08568 None admin] RBAC: Authorizing `identity:create_grant(project_id=60f8594760e44ce3888a32702ea9afcc, user_id=1b94f1f12db3473f9ce1f33d2d9056a7, role_id=832e4b25a75c4d30a010d6803a5a4577)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:04.061276 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d989059-02b5-46c2-a13d-331206a08568 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:04.073994 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 189/399] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 23 00:43:03 2022] PUT /identity/v3/projects/60f8594760e44ce3888a32702ea9afcc/users/1b94f1f12db3473f9ce1f33d2d9056a7/roles/832e4b25a75c4d30a010d6803a5a4577 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:43:04.074810 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d989059-02b5-46c2-a13d-331206a08568 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:04.092551 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c538f4c6-12d9-4bd9-82d9-65e49dbfcbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:04.093753 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538f4c6-12d9-4bd9-82d9-65e49dbfcbce None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:04.094231 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538f4c6-12d9-4bd9-82d9-65e49dbfcbce None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:04.094822 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538f4c6-12d9-4bd9-82d9-65e49dbfcbce None admin] PATH_INFO: `/v3/domains` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:04.096039 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c538f4c6-12d9-4bd9-82d9-65e49dbfcbce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:04.096588 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c538f4c6-12d9-4bd9-82d9-65e49dbfcbce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:04.098312 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c538f4c6-12d9-4bd9-82d9-65e49dbfcbce None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:04.117430 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 211/400] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:43:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:04.118555 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c538f4c6-12d9-4bd9-82d9-65e49dbfcbce None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:04.144722 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:04.178399 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:04.195261 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d989059-02b5-46c2-a13d-331206a08568 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:04.237177 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2d2fc-96ad-476d-a9ca-45047ffa24ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:04.237805 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2d2fc-96ad-476d-a9ca-45047ffa24ed None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:04.238108 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2d2fc-96ad-476d-a9ca-45047ffa24ed None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:04.238383 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2d2fc-96ad-476d-a9ca-45047ffa24ed None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:04.240692 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c538f4c6-12d9-4bd9-82d9-65e49dbfcbce None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:04.247878 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f2d2fc-96ad-476d-a9ca-45047ffa24ed None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:04.249121 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f2d2fc-96ad-476d-a9ca-45047ffa24ed None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:04.263942 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-e3f2d2fc-96ad-476d-a9ca-45047ffa24ed None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 23 00:43:04.263942 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:04.263942 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:04.263942 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:04.263942 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:04.263942 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:04.263942 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:04.263942 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:04.263942 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:04.263942 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:04.263942 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:04.263942 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:04.263942 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 00:43:04.263942 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 00:43:04.263942 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 00:43:04.263942 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 00:43:04.264904 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:04.264904 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:04.264904 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:43:04.264904 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:43:04.264904 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:43:04.264904 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:43:04.264904 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:04.264904 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:04.264904 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:04.264904 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:04.264904 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:04.264904 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:04.264904 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:04.264904 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:04.264904 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:04.264904 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:04.264904 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:04.264904 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:04.265804 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:04.265804 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:04.265804 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 00:43:04.265804 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 00:43:04.265804 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 00:43:04.265804 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 00:43:04.265804 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 00:43:04.265804 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 00:43:04.265804 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 23 00:43:04.265804 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:04.265804 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 190/401] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 23 00:43:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:04.266453 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2d2fc-96ad-476d-a9ca-45047ffa24ed None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:04.286717 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad48b32-5236-4e16-a3ae-546f7b226230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:04.287330 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad48b32-5236-4e16-a3ae-546f7b226230 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:04.287624 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad48b32-5236-4e16-a3ae-546f7b226230 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:04.287887 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad48b32-5236-4e16-a3ae-546f7b226230 None admin] PATH_INFO: `/v3/domains` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:04.288533 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad48b32-5236-4e16-a3ae-546f7b226230 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:04.288833 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad48b32-5236-4e16-a3ae-546f7b226230 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:04.290239 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad48b32-5236-4e16-a3ae-546f7b226230 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:04.302332 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 212/402] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:43:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:04.303056 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad48b32-5236-4e16-a3ae-546f7b226230 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:04.375810 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2d2fc-96ad-476d-a9ca-45047ffa24ed None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:04.400273 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:04.409780 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad48b32-5236-4e16-a3ae-546f7b226230 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:04.411998 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe37f3c-9c45-4d3a-a2f2-7cdb2e6660a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:04.412609 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe37f3c-9c45-4d3a-a2f2-7cdb2e6660a2 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:04.412894 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe37f3c-9c45-4d3a-a2f2-7cdb2e6660a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:04.413173 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe37f3c-9c45-4d3a-a2f2-7cdb2e6660a2 None admin] PATH_INFO: `/v3/users` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:04.413956 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe37f3c-9c45-4d3a-a2f2-7cdb2e6660a2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:04.414348 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe37f3c-9c45-4d3a-a2f2-7cdb2e6660a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:04.415809 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe37f3c-9c45-4d3a-a2f2-7cdb2e6660a2 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:04.417416 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:04.436754 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 191/403] 10.222.0.23 () {56 vars in 1137 bytes} [Sun Oct 23 00:43:04 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:04.437594 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe37f3c-9c45-4d3a-a2f2-7cdb2e6660a2 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:04.453199 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9642ab39-1eb4-4191-a9b3-3eb5f3a1c676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:04.453923 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642ab39-1eb4-4191-a9b3-3eb5f3a1c676 None admin] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:04.454242 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642ab39-1eb4-4191-a9b3-3eb5f3a1c676 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:04.454638 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642ab39-1eb4-4191-a9b3-3eb5f3a1c676 None admin] PATH_INFO: `/v3/users` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:04.455291 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9642ab39-1eb4-4191-a9b3-3eb5f3a1c676 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:04.456730 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9642ab39-1eb4-4191-a9b3-3eb5f3a1c676 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:04.489459 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 213/404] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 23 00:43:04 2022] POST /identity/v3/users => generated 247 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:43:04.489459 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9642ab39-1eb4-4191-a9b3-3eb5f3a1c676 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:04.576359 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe37f3c-9c45-4d3a-a2f2-7cdb2e6660a2 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:04.602643 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9642ab39-1eb4-4191-a9b3-3eb5f3a1c676 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:04.631015 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f44a7-54bd-4471-abce-25e2097a71c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:04.631999 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f44a7-54bd-4471-abce-25e2097a71c8 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:04.632351 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f44a7-54bd-4471-abce-25e2097a71c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:04.633176 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f44a7-54bd-4471-abce-25e2097a71c8 None admin] PATH_INFO: `/v3/users` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:04.634344 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351f44a7-54bd-4471-abce-25e2097a71c8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:04.634766 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351f44a7-54bd-4471-abce-25e2097a71c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:04.637533 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351f44a7-54bd-4471-abce-25e2097a71c8 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:04.641123 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f317a-9972-49a5-959b-e402308c3f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:04.641855 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f317a-9972-49a5-959b-e402308c3f61 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:04.642161 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f317a-9972-49a5-959b-e402308c3f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:04.642437 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f317a-9972-49a5-959b-e402308c3f61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:04.650157 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f317a-9972-49a5-959b-e402308c3f61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:04.651708 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f317a-9972-49a5-959b-e402308c3f61 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:04.661744 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 192/405] 10.222.0.23 () {56 vars in 1139 bytes} [Sun Oct 23 00:43:04 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:04.663069 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f44a7-54bd-4471-abce-25e2097a71c8 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:04.664836 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-077f317a-9972-49a5-959b-e402308c3f61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:43:04.664836 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:04.664836 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:04.664836 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:04.664836 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:04.664836 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:04.664836 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:04.664836 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:04.664836 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:04.664836 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:04.664836 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:04.664836 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:04.664836 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 00:43:04.664836 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 00:43:04.664836 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 00:43:04.665682 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 00:43:04.665682 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:04.665682 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:04.665682 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:04.665682 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:04.665682 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:04.665682 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:04.665682 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:04.665682 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:04.665682 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:04.665682 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:04.665682 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:04.665682 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:04.665682 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:04.665682 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:04.665682 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:04.665682 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:04.667227 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 00:43:04.667227 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 00:43:04.667227 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 00:43:04.667227 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 00:43:04.667227 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 00:43:04.667227 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 00:43:04.667227 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:43:04.667227 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:04.670840 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 214/406] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 23 00:43:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:04.671698 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f317a-9972-49a5-959b-e402308c3f61 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:04.703009 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:04.727721 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:04.805403 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f317a-9972-49a5-959b-e402308c3f61 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:04.815892 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f44a7-54bd-4471-abce-25e2097a71c8 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:04.852885 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a833f1-822d-4dbd-b215-aec6189961b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:04.853287 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c6b06e-d8e2-43d4-9b7b-5ffc82bcd293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:04.853750 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a833f1-822d-4dbd-b215-aec6189961b3 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:04.854165 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a833f1-822d-4dbd-b215-aec6189961b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:04.854443 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6b06e-d8e2-43d4-9b7b-5ffc82bcd293 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:04.854631 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a833f1-822d-4dbd-b215-aec6189961b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:04.855024 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6b06e-d8e2-43d4-9b7b-5ffc82bcd293 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:04.855436 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6b06e-d8e2-43d4-9b7b-5ffc82bcd293 None admin] PATH_INFO: `/v3/projects` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:04.856517 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c6b06e-d8e2-43d4-9b7b-5ffc82bcd293 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:04.857241 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c6b06e-d8e2-43d4-9b7b-5ffc82bcd293 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:04.859139 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c6b06e-d8e2-43d4-9b7b-5ffc82bcd293 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:04.867646 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a833f1-822d-4dbd-b215-aec6189961b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:04.869219 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a833f1-822d-4dbd-b215-aec6189961b3 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:04.877149 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 215/407] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 23 00:43:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:04.878290 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c6b06e-d8e2-43d4-9b7b-5ffc82bcd293 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:04.893007 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-17a833f1-822d-4dbd-b215-aec6189961b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:04.893007 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:04.893007 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:04.893007 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:04.893007 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:04.893007 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:04.893007 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:04.893007 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:04.893007 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:04.893007 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:04.893007 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:04.893007 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:04.893007 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:43:04.893007 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:43:04.893007 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:43:04.893007 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:43:04.894182 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:04.894182 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:04.894182 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:04.894182 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:04.894182 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:04.894182 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:04.894182 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:04.894182 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:04.894182 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:04.894182 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:04.894182 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:04.894182 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:04.894182 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:04.894182 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:04.894182 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:04.894182 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:04.894182 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:43:04.895346 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:43:04.895346 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:04.895346 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:04.897146 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 193/408] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:43:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:04.898206 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a833f1-822d-4dbd-b215-aec6189961b3 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:05.002223 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:05.014332 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:05.025856 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a833f1-822d-4dbd-b215-aec6189961b3 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:05.031180 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c6b06e-d8e2-43d4-9b7b-5ffc82bcd293 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:05.062041 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0dd81-fa15-48b1-b22b-11f7e7fd3b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:05.062734 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0dd81-fa15-48b1-b22b-11f7e7fd3b0c None admin] REQUEST_METHOD: `PUT` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:05.063018 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0dd81-fa15-48b1-b22b-11f7e7fd3b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:05.063299 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0dd81-fa15-48b1-b22b-11f7e7fd3b0c None admin] PATH_INFO: `/v3/projects/60f8594760e44ce3888a32702ea9afcc/users/90f691140a8341ada73a8c6f01ad798c/roles/832e4b25a75c4d30a010d6803a5a4577` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:05.079614 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f0dd81-fa15-48b1-b22b-11f7e7fd3b0c None admin] RBAC: Authorizing `identity:create_grant(project_id=60f8594760e44ce3888a32702ea9afcc, user_id=90f691140a8341ada73a8c6f01ad798c, role_id=832e4b25a75c4d30a010d6803a5a4577)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:05.080181 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a72e816-0e52-4f90-b305-efd4f8753525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:05.081038 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72e816-0e52-4f90-b305-efd4f8753525 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:05.081144 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f0dd81-fa15-48b1-b22b-11f7e7fd3b0c None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:05.081614 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72e816-0e52-4f90-b305-efd4f8753525 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:05.082131 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72e816-0e52-4f90-b305-efd4f8753525 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:05.095564 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a72e816-0e52-4f90-b305-efd4f8753525 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:05.097648 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a72e816-0e52-4f90-b305-efd4f8753525 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:05.106537 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 194/409] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 23 00:43:04 2022] PUT /identity/v3/projects/60f8594760e44ce3888a32702ea9afcc/users/90f691140a8341ada73a8c6f01ad798c/roles/832e4b25a75c4d30a010d6803a5a4577 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:43:05.107646 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0dd81-fa15-48b1-b22b-11f7e7fd3b0c None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:05.118256 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-2a72e816-0e52-4f90-b305-efd4f8753525 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:05.118256 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:05.118256 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:05.118256 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:05.118256 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:05.118256 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:05.118256 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:05.118256 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:05.118256 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:05.118256 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:05.118256 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:05.118256 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:05.118256 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:43:05.118256 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:43:05.118256 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:43:05.118256 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:43:05.119202 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:05.119202 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:05.119202 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:05.119202 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:05.119202 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:05.119202 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:05.119202 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:05.119202 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:05.119202 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:05.119202 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:05.119202 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:05.119202 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:05.119202 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:05.119202 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:05.119202 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:05.119202 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:05.119202 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:43:05.120050 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:43:05.120050 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:05.120050 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:05.122877 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 216/410] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:43:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:05.132614 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a72e816-0e52-4f90-b305-efd4f8753525 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:05.295559 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0dd81-fa15-48b1-b22b-11f7e7fd3b0c None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:05.341377 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3814cc-28f0-43f0-9739-a6114e50b461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:05.342046 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3814cc-28f0-43f0-9739-a6114e50b461 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:05.342369 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3814cc-28f0-43f0-9739-a6114e50b461 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:05.343899 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3814cc-28f0-43f0-9739-a6114e50b461 None admin] PATH_INFO: `/v3/domains` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:05.343899 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3814cc-28f0-43f0-9739-a6114e50b461 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:05.343899 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3814cc-28f0-43f0-9739-a6114e50b461 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:05.345198 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3814cc-28f0-43f0-9739-a6114e50b461 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:05.359636 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 195/411] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:05.366259 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3814cc-28f0-43f0-9739-a6114e50b461 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:05.369014 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a72e816-0e52-4f90-b305-efd4f8753525 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:05.369521 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:05.412265 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d095f7-c376-440a-ba84-d611c308281a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:05.413241 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d095f7-c376-440a-ba84-d611c308281a None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:05.413799 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d095f7-c376-440a-ba84-d611c308281a None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:05.414344 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d095f7-c376-440a-ba84-d611c308281a None admin] PATH_INFO: `/v3/domains` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:05.415256 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d095f7-c376-440a-ba84-d611c308281a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:05.415888 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d095f7-c376-440a-ba84-d611c308281a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:05.417589 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d095f7-c376-440a-ba84-d611c308281a None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:05.419320 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:05.434425 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 217/412] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:05.440195 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d095f7-c376-440a-ba84-d611c308281a None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:05.483389 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3814cc-28f0-43f0-9739-a6114e50b461 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:05.520073 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd7baa-6255-427f-823d-6ecc62bbb7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:05.520748 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd7baa-6255-427f-823d-6ecc62bbb7bf None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:05.521038 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd7baa-6255-427f-823d-6ecc62bbb7bf None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:05.521319 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd7baa-6255-427f-823d-6ecc62bbb7bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:05.528518 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd7baa-6255-427f-823d-6ecc62bbb7bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:05.530005 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd7baa-6255-427f-823d-6ecc62bbb7bf None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:05.543396 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-80cd7baa-6255-427f-823d-6ecc62bbb7bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:43:05.543396 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:05.543396 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:05.543396 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:05.543396 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:05.543396 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:05.543396 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:05.543396 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:05.543396 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:05.543396 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:05.543396 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:05.543396 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:05.543396 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 00:43:05.543396 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 00:43:05.543396 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 00:43:05.544274 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 00:43:05.544274 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:05.544274 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:05.544274 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:05.544274 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:05.544274 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:05.544274 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:05.544274 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:05.544274 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:05.544274 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:05.544274 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:05.544274 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:05.544274 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:05.544274 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:05.544274 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:05.544274 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:05.544274 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:05.545715 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 00:43:05.545715 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 00:43:05.545715 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 00:43:05.545715 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 00:43:05.545715 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 00:43:05.545715 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 00:43:05.545715 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:43:05.545715 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:05.545715 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 196/413] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 23 00:43:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:05.555042 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd7baa-6255-427f-823d-6ecc62bbb7bf None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:05.646668 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d095f7-c376-440a-ba84-d611c308281a None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:05.647725 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:05.705177 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd7baa-6255-427f-823d-6ecc62bbb7bf None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:05.740139 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6377f37-f8a2-46d4-9bf6-66d422a9e29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:05.742024 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6377f37-f8a2-46d4-9bf6-66d422a9e29c None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:05.743236 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6377f37-f8a2-46d4-9bf6-66d422a9e29c None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:05.744219 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6377f37-f8a2-46d4-9bf6-66d422a9e29c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:05.748100 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90270640-0ac3-4971-a682-794823115d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:05.749329 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90270640-0ac3-4971-a682-794823115d67 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:05.750769 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90270640-0ac3-4971-a682-794823115d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:05.752797 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90270640-0ac3-4971-a682-794823115d67 None admin] PATH_INFO: `/v3/projects` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:05.753731 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90270640-0ac3-4971-a682-794823115d67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:05.755191 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90270640-0ac3-4971-a682-794823115d67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:05.756858 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90270640-0ac3-4971-a682-794823115d67 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:05.761041 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6377f37-f8a2-46d4-9bf6-66d422a9e29c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:05.765462 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6377f37-f8a2-46d4-9bf6-66d422a9e29c None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:05.784109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-b6377f37-f8a2-46d4-9bf6-66d422a9e29c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:43:05.784109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:05.784109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:05.784109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:05.784109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:05.784109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:05.784109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:05.784109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:05.784109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:05.784109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:05.784109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:05.784109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:05.784109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 00:43:05.784109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 00:43:05.784109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 00:43:05.785018 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 00:43:05.785018 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:05.785018 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:05.785018 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:05.785018 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:05.785018 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:05.785018 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:05.785018 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:05.785018 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:05.785018 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:05.785018 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:05.785018 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:05.785018 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:05.785018 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:05.785018 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:05.785018 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:05.785018 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:05.787072 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 00:43:05.787072 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 00:43:05.787072 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 00:43:05.787072 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 00:43:05.787072 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 00:43:05.787072 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 00:43:05.787072 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:43:05.787072 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:05.787072 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 218/414] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 23 00:43:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:43:05.794430 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 197/415] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 23 00:43:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:05.795251 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6377f37-f8a2-46d4-9bf6-66d422a9e29c None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:05.799669 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90270640-0ac3-4971-a682-794823115d67 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:05.924016 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90270640-0ac3-4971-a682-794823115d67 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:05.947657 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:05.951630 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:05.965390 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d2c99-80f7-4270-a350-f786302e533e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:05.966559 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d2c99-80f7-4270-a350-f786302e533e None admin] REQUEST_METHOD: `PUT` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:05.967065 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d2c99-80f7-4270-a350-f786302e533e None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:05.967548 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d2c99-80f7-4270-a350-f786302e533e None admin] PATH_INFO: `/v3/projects/60f8594760e44ce3888a32702ea9afcc/users/57aa88f06f88438c8f0d4d2e65be71c0/roles/832e4b25a75c4d30a010d6803a5a4577` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:05.985632 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d2c99-80f7-4270-a350-f786302e533e None admin] RBAC: Authorizing `identity:create_grant(project_id=60f8594760e44ce3888a32702ea9afcc, user_id=57aa88f06f88438c8f0d4d2e65be71c0, role_id=832e4b25a75c4d30a010d6803a5a4577)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:05.987997 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d2c99-80f7-4270-a350-f786302e533e None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:06.008978 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 198/416] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 23 00:43:05 2022] PUT /identity/v3/projects/60f8594760e44ce3888a32702ea9afcc/users/57aa88f06f88438c8f0d4d2e65be71c0/roles/832e4b25a75c4d30a010d6803a5a4577 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:43:06.039984 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6377f37-f8a2-46d4-9bf6-66d422a9e29c None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:06.080227 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bcd8f2-ea43-46c2-83ff-241f57bc7b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:06.081269 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bcd8f2-ea43-46c2-83ff-241f57bc7b74 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:06.081758 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bcd8f2-ea43-46c2-83ff-241f57bc7b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:06.082264 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bcd8f2-ea43-46c2-83ff-241f57bc7b74 None admin] PATH_INFO: `/v3/projects` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:06.083751 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bcd8f2-ea43-46c2-83ff-241f57bc7b74 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:06.084260 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bcd8f2-ea43-46c2-83ff-241f57bc7b74 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:06.085909 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bcd8f2-ea43-46c2-83ff-241f57bc7b74 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:06.100359 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 219/417] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 23 00:43:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:06.107427 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d2c99-80f7-4270-a350-f786302e533e None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:06.262342 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d2c99-80f7-4270-a350-f786302e533e None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:06.299959 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2766dc63-fcc2-4941-ae30-ac3ad7a905f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:06.300953 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766dc63-fcc2-4941-ae30-ac3ad7a905f0 None admin] REQUEST_METHOD: `PUT` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:06.302006 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766dc63-fcc2-4941-ae30-ac3ad7a905f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:06.302526 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766dc63-fcc2-4941-ae30-ac3ad7a905f0 None admin] PATH_INFO: `/v3/projects/60f8594760e44ce3888a32702ea9afcc/users/04804cfc28b84d398ef06e8e113a755d/roles/832e4b25a75c4d30a010d6803a5a4577` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:06.319869 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2766dc63-fcc2-4941-ae30-ac3ad7a905f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=60f8594760e44ce3888a32702ea9afcc, user_id=04804cfc28b84d398ef06e8e113a755d, role_id=832e4b25a75c4d30a010d6803a5a4577)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:06.321661 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2766dc63-fcc2-4941-ae30-ac3ad7a905f0 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:06.340418 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 199/418] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 23 00:43:06 2022] PUT /identity/v3/projects/60f8594760e44ce3888a32702ea9afcc/users/04804cfc28b84d398ef06e8e113a755d/roles/832e4b25a75c4d30a010d6803a5a4577 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:43:06.367786 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943f9a3-628c-43f3-8f92-dd8bf67c4e85 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:06.368445 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943f9a3-628c-43f3-8f92-dd8bf67c4e85 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:06.368969 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943f9a3-628c-43f3-8f92-dd8bf67c4e85 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:06.371222 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 220/419] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:43:06.376736 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e50d1b-0c33-4438-a75d-89fb15658d35 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:06.377055 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e50d1b-0c33-4438-a75d-89fb15658d35 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:06.377307 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e50d1b-0c33-4438-a75d-89fb15658d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:06.399715 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-55e50d1b-0c33-4438-a75d-89fb15658d35 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:06.401120 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-55e50d1b-0c33-4438-a75d-89fb15658d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:06.422137 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:06.493292 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 200/420] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:43:06.776401 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943f9a3-628c-43f3-8f92-dd8bf67c4e85 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:06.908897 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943f9a3-628c-43f3-8f92-dd8bf67c4e85 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:06.932796 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:06.953499 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5397b4-49ba-4154-8ff6-df4795c64ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:06.954212 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5397b4-49ba-4154-8ff6-df4795c64ea5 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:06.954497 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5397b4-49ba-4154-8ff6-df4795c64ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:06.954770 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5397b4-49ba-4154-8ff6-df4795c64ea5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:06.966192 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5397b4-49ba-4154-8ff6-df4795c64ea5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:43:06.971225 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-bd5397b4-49ba-4154-8ff6-df4795c64ea5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:43:06.971225 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:06.971225 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:06.971225 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:06.971225 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:06.971225 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:06.971225 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:06.971225 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:06.971225 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:06.971225 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:06.971225 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:06.971225 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:06.971225 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:43:06.971225 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:43:06.971225 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:43:06.971225 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:43:06.972113 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:43:06.972113 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:43:06.972113 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:43:06.972113 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:43:06.972113 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:06.972113 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:06.972113 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:06.972113 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:06.972113 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:06.972113 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:06.972113 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:06.972113 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:06.972113 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:06.972113 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:06.972113 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:06.972113 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:06.973345 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:06.973345 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:06.973345 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:06.973345 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:06.973345 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:43:06.973345 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:43:06.973345 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:43:06.973345 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:43:06.973345 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:43:06.973345 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:43:06.973345 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:43:06.973345 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:06.973345 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 221/421] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 23 00:43:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:06.978595 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e50d1b-0c33-4438-a75d-89fb15658d35 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:07.102971 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e50d1b-0c33-4438-a75d-89fb15658d35 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:07.143093 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff8dbe-abd4-4e03-b7ce-3b3b7cabad01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:07.143739 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff8dbe-abd4-4e03-b7ce-3b3b7cabad01 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:07.144025 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff8dbe-abd4-4e03-b7ce-3b3b7cabad01 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:07.144293 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff8dbe-abd4-4e03-b7ce-3b3b7cabad01 None admin] PATH_INFO: `/v3/roles` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:07.144984 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff8dbe-abd4-4e03-b7ce-3b3b7cabad01 None admin] RBAC: Adding query filter params (name=service) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:07.145896 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff8dbe-abd4-4e03-b7ce-3b3b7cabad01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:07.147349 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff8dbe-abd4-4e03-b7ce-3b3b7cabad01 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:07.157202 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 201/422] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Oct 23 00:43:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:07.163446 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5397b4-49ba-4154-8ff6-df4795c64ea5 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:07.277267 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d4f08-b7da-4b4d-bcc1-0ef490fad31e None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:07.277576 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d4f08-b7da-4b4d-bcc1-0ef490fad31e None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:07.277829 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d4f08-b7da-4b4d-bcc1-0ef490fad31e None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:07.279946 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 202/423] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:43:07.285017 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfec623-1967-4066-b125-c768610c8d9c None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:07.285308 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfec623-1967-4066-b125-c768610c8d9c None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:07.285590 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfec623-1967-4066-b125-c768610c8d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:07.305720 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-3cfec623-1967-4066-b125-c768610c8d9c None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:07.307021 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-3cfec623-1967-4066-b125-c768610c8d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:07.313681 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5397b4-49ba-4154-8ff6-df4795c64ea5 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:07.318707 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:07.382719 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61daa9ed-cbc2-4c19-9164-06f99108a368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:07.383359 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61daa9ed-cbc2-4c19-9164-06f99108a368 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:07.383617 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 203/424] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 00:43:07.384727 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61daa9ed-cbc2-4c19-9164-06f99108a368 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:07.385028 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61daa9ed-cbc2-4c19-9164-06f99108a368 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:07.404081 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61daa9ed-cbc2-4c19-9164-06f99108a368 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:07.405570 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61daa9ed-cbc2-4c19-9164-06f99108a368 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:07.431486 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-61daa9ed-cbc2-4c19-9164-06f99108a368 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:07.431486 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:07.431486 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:07.431486 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:07.431486 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:07.431486 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:07.431486 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:07.431486 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:07.431486 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:07.431486 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:07.431486 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:07.431486 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:07.431486 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:43:07.431486 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:43:07.431486 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:43:07.431486 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:43:07.432439 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:07.432439 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:07.432439 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:07.432439 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:07.432439 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:07.432439 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:07.432439 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:07.432439 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:07.432439 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:07.432439 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:07.432439 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:07.432439 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:07.432439 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:07.432439 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:07.432439 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:07.432439 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:07.432439 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:43:07.433289 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:43:07.433289 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:07.433289 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:07.433899 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 222/425] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:43:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:07.438303 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfec623-1967-4066-b125-c768610c8d9c None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:07.568637 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfec623-1967-4066-b125-c768610c8d9c None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:07.606619 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1362122-8cf1-4169-ad0e-e48fe0da54b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:07.607304 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1362122-8cf1-4169-ad0e-e48fe0da54b9 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:07.607591 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1362122-8cf1-4169-ad0e-e48fe0da54b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:07.607865 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1362122-8cf1-4169-ad0e-e48fe0da54b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:07.608537 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1362122-8cf1-4169-ad0e-e48fe0da54b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:07.608841 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1362122-8cf1-4169-ad0e-e48fe0da54b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:07.610293 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1362122-8cf1-4169-ad0e-e48fe0da54b9 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:07.624195 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 204/426] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:07.630148 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61daa9ed-cbc2-4c19-9164-06f99108a368 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:07.664003 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:07.731947 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad975647-ad3d-48a8-85e4-18bb23b0f9d4 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:07.732268 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad975647-ad3d-48a8-85e4-18bb23b0f9d4 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:07.732515 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad975647-ad3d-48a8-85e4-18bb23b0f9d4 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:07.734155 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 205/427] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:43:07.739383 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbedc7cb-c25b-4b0f-b269-b8e730f20f4d None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:07.739778 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbedc7cb-c25b-4b0f-b269-b8e730f20f4d None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:07.740629 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbedc7cb-c25b-4b0f-b269-b8e730f20f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:07.748962 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:07.763086 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-fbedc7cb-c25b-4b0f-b269-b8e730f20f4d None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:07.764539 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-fbedc7cb-c25b-4b0f-b269-b8e730f20f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:07.777500 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61daa9ed-cbc2-4c19-9164-06f99108a368 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:07.831890 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5981b9-6d57-4bf1-8705-df7146c6bc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:07.833348 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5981b9-6d57-4bf1-8705-df7146c6bc7a None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:07.833776 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5981b9-6d57-4bf1-8705-df7146c6bc7a None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:07.834266 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5981b9-6d57-4bf1-8705-df7146c6bc7a None admin] PATH_INFO: `/v3/users/glance` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:07.843433 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 206/428] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:43:07.848479 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5981b9-6d57-4bf1-8705-df7146c6bc7a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:07.850191 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5981b9-6d57-4bf1-8705-df7146c6bc7a None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:07.862825 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-bb5981b9-6d57-4bf1-8705-df7146c6bc7a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 23 00:43:07.862825 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:07.862825 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:07.862825 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:07.862825 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:07.862825 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:07.862825 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:07.862825 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:07.862825 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:07.862825 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:07.862825 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:07.862825 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:07.862825 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 00:43:07.862825 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 00:43:07.862825 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 00:43:07.862825 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 00:43:07.864781 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:07.864781 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:07.864781 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:43:07.864781 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:43:07.864781 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:43:07.864781 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:43:07.864781 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:07.864781 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:07.864781 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:07.864781 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:07.864781 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:07.864781 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:07.864781 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:07.864781 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:07.864781 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:07.864781 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:07.864781 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:07.864781 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:07.865635 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:07.865635 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:07.865635 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 00:43:07.865635 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 00:43:07.865635 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 00:43:07.865635 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 00:43:07.865635 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 00:43:07.865635 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 00:43:07.865635 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 23 00:43:07.865635 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:07.868190 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 223/429] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 23 00:43:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:07.875895 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbedc7cb-c25b-4b0f-b269-b8e730f20f4d None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:07.878252 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5981b9-6d57-4bf1-8705-df7146c6bc7a None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:07.981009 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbedc7cb-c25b-4b0f-b269-b8e730f20f4d None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:08.015212 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:08.020037 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee13478-32f9-471c-a598-de7f1693f74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:08.021096 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee13478-32f9-471c-a598-de7f1693f74c None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:08.021596 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee13478-32f9-471c-a598-de7f1693f74c None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:08.022106 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee13478-32f9-471c-a598-de7f1693f74c None admin] PATH_INFO: `/v3/users` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:08.023039 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee13478-32f9-471c-a598-de7f1693f74c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:08.023549 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee13478-32f9-471c-a598-de7f1693f74c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:08.025196 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee13478-32f9-471c-a598-de7f1693f74c None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:08.027213 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:08.040433 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5981b9-6d57-4bf1-8705-df7146c6bc7a None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:08.046480 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 207/430] 10.222.0.23 () {56 vars in 1137 bytes} [Sun Oct 23 00:43:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:08.052534 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee13478-32f9-471c-a598-de7f1693f74c None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:08.104395 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee447114-5865-4d14-8bf4-e478976e52fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:08.105180 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee447114-5865-4d14-8bf4-e478976e52fe None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:08.105450 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee447114-5865-4d14-8bf4-e478976e52fe None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:08.105980 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee447114-5865-4d14-8bf4-e478976e52fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:08.127904 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee447114-5865-4d14-8bf4-e478976e52fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:43:08.133796 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-ee447114-5865-4d14-8bf4-e478976e52fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:43:08.133796 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:08.133796 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:08.133796 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:08.133796 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:08.133796 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:08.133796 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:08.133796 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:08.133796 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:08.133796 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:08.133796 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:08.133796 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:08.133796 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:43:08.133796 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:43:08.133796 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:43:08.133796 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:43:08.134724 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:43:08.134724 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:43:08.134724 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:43:08.134724 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:43:08.134724 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:08.134724 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:08.134724 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:08.134724 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:08.134724 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:08.134724 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:08.134724 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:08.134724 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:08.134724 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:08.134724 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:08.134724 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:08.134724 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:08.135510 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:08.135510 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:08.135510 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:08.135510 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:08.135510 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:43:08.135510 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:43:08.135510 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:43:08.135510 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:43:08.135510 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:43:08.135510 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:43:08.135510 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:43:08.135510 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:08.139110 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 224/431] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 23 00:43:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:43:08.140156 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee447114-5865-4d14-8bf4-e478976e52fe None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:08.176334 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee13478-32f9-471c-a598-de7f1693f74c None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:08.218463 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfdc391-f910-481e-8251-5dd1175ace25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:08.219505 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdc391-f910-481e-8251-5dd1175ace25 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:08.219795 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdc391-f910-481e-8251-5dd1175ace25 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:08.220078 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdc391-f910-481e-8251-5dd1175ace25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:08.265126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee447114-5865-4d14-8bf4-e478976e52fe None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:08.295040 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:08.304040 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5effcda-518f-4e94-bf96-b25b155567b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:08.305162 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5effcda-518f-4e94-bf96-b25b155567b4 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:08.305664 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5effcda-518f-4e94-bf96-b25b155567b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:08.306182 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5effcda-518f-4e94-bf96-b25b155567b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:08.307210 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfdc391-f910-481e-8251-5dd1175ace25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:08.308943 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfdc391-f910-481e-8251-5dd1175ace25 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:08.318526 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5effcda-518f-4e94-bf96-b25b155567b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:43:08.325698 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-d5effcda-518f-4e94-bf96-b25b155567b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:43:08.325698 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:08.325698 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:08.325698 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:08.325698 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:08.325698 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:08.325698 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:08.325698 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:08.325698 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:08.325698 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:08.325698 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:08.325698 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:08.325698 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:43:08.325698 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:43:08.325698 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:43:08.325698 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:43:08.326625 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:43:08.326625 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:43:08.326625 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:43:08.326625 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:43:08.326625 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:08.326625 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:08.326625 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:08.326625 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:08.326625 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:08.326625 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:08.326625 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:08.326625 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:08.326625 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:08.326625 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:08.326625 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:08.326625 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:08.327427 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:08.327427 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:08.327427 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:08.327427 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:08.327427 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:43:08.327427 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:43:08.327427 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:43:08.327427 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:43:08.327427 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:43:08.327427 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:43:08.327427 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:43:08.327427 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:08.330118 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 225/432] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 23 00:43:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:08.331242 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5effcda-518f-4e94-bf96-b25b155567b4 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:08.342033 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:08.437592 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 208/433] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 23 00:43:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 23 00:43:08.437592 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfdc391-f910-481e-8251-5dd1175ace25 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:08.449648 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5effcda-518f-4e94-bf96-b25b155567b4 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:08.493614 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305273bb-e9ec-4068-b7b8-b43b80d3be3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:08.494259 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305273bb-e9ec-4068-b7b8-b43b80d3be3e None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:08.494540 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305273bb-e9ec-4068-b7b8-b43b80d3be3e None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:08.494810 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305273bb-e9ec-4068-b7b8-b43b80d3be3e None admin] PATH_INFO: `/v3/roles` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:08.495472 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305273bb-e9ec-4068-b7b8-b43b80d3be3e None admin] RBAC: Adding query filter params (name=service) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:08.495774 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305273bb-e9ec-4068-b7b8-b43b80d3be3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:08.497229 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305273bb-e9ec-4068-b7b8-b43b80d3be3e None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:08.510276 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 226/434] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Oct 23 00:43:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:08.511137 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305273bb-e9ec-4068-b7b8-b43b80d3be3e None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:08.552325 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:08.564724 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfdc391-f910-481e-8251-5dd1175ace25 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:08.587086 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:08.609488 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed94e6f-610a-4e41-9309-4436d195a664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:08.610482 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed94e6f-610a-4e41-9309-4436d195a664 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:08.610984 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed94e6f-610a-4e41-9309-4436d195a664 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:08.611461 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed94e6f-610a-4e41-9309-4436d195a664 None admin] PATH_INFO: `/v3/roles` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:08.612440 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed94e6f-610a-4e41-9309-4436d195a664 None admin] RBAC: Adding query filter params (name=service) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:08.612960 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed94e6f-610a-4e41-9309-4436d195a664 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:08.615232 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed94e6f-610a-4e41-9309-4436d195a664 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:08.625669 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305273bb-e9ec-4068-b7b8-b43b80d3be3e None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:08.630948 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 209/435] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Oct 23 00:43:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:08.632081 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed94e6f-610a-4e41-9309-4436d195a664 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:08.662567 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3044bb2f-6ad4-4219-bdb7-d36fe3e96e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:08.663208 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044bb2f-6ad4-4219-bdb7-d36fe3e96e82 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:08.663492 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044bb2f-6ad4-4219-bdb7-d36fe3e96e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:08.663769 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044bb2f-6ad4-4219-bdb7-d36fe3e96e82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:08.675102 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3044bb2f-6ad4-4219-bdb7-d36fe3e96e82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:08.676597 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3044bb2f-6ad4-4219-bdb7-d36fe3e96e82 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:08.690759 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-3044bb2f-6ad4-4219-bdb7-d36fe3e96e82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:08.690759 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:08.690759 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:08.690759 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:08.690759 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:08.690759 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:08.690759 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:08.690759 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:08.690759 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:08.690759 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:08.690759 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:08.690759 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:08.690759 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:43:08.690759 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:43:08.690759 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:43:08.690759 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:43:08.691716 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:08.691716 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:08.691716 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:08.691716 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:08.691716 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:08.691716 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:08.691716 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:08.691716 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:08.691716 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:08.691716 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:08.691716 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:08.691716 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:08.691716 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:08.691716 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:08.691716 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:08.691716 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:08.691716 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:43:08.692573 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:43:08.692573 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:08.692573 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:08.692573 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 227/436] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:43:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:08.692792 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3044bb2f-6ad4-4219-bdb7-d36fe3e96e82 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:08.746345 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed94e6f-610a-4e41-9309-4436d195a664 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:08.783018 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d8477-7050-4eb8-bfec-5fa88af6441c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:08.783648 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d8477-7050-4eb8-bfec-5fa88af6441c None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:08.783932 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d8477-7050-4eb8-bfec-5fa88af6441c None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:08.784210 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d8477-7050-4eb8-bfec-5fa88af6441c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:08.796367 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874d8477-7050-4eb8-bfec-5fa88af6441c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:08.798028 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874d8477-7050-4eb8-bfec-5fa88af6441c None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:08.802001 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3044bb2f-6ad4-4219-bdb7-d36fe3e96e82 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:08.812569 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-874d8477-7050-4eb8-bfec-5fa88af6441c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:08.812569 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:08.812569 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:08.812569 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:08.812569 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:08.812569 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:08.812569 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:08.812569 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:08.812569 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:08.812569 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:08.812569 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:08.812569 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:08.812569 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:43:08.812569 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:43:08.812569 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:43:08.812569 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:43:08.813439 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:08.813439 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:08.813439 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:08.813439 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:08.813439 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:08.813439 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:08.813439 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:08.813439 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:08.813439 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:08.813439 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:08.813439 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:08.813439 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:08.813439 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:08.813439 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:08.813439 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:08.813439 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:08.813439 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:43:08.814304 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:43:08.814304 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:08.814304 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:08.814304 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 210/437] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:43:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:08.815387 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585341c9-0ea6-4dea-90d4-5e4affc419ea None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:08.815669 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585341c9-0ea6-4dea-90d4-5e4affc419ea None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:08.815948 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585341c9-0ea6-4dea-90d4-5e4affc419ea None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:08.821438 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 211/438] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:43:08.821438 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585341c9-0ea6-4dea-90d4-5e4affc419ea None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:08.830891 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:08.834473 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:08.850987 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe19850-b383-4cfd-b63d-5bf895341923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:08.851626 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe19850-b383-4cfd-b63d-5bf895341923 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:08.851913 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe19850-b383-4cfd-b63d-5bf895341923 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:08.852187 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe19850-b383-4cfd-b63d-5bf895341923 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:08.863677 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe19850-b383-4cfd-b63d-5bf895341923 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:08.865146 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe19850-b383-4cfd-b63d-5bf895341923 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:08.879247 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-ebe19850-b383-4cfd-b63d-5bf895341923 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:08.879247 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:08.879247 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:08.879247 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:08.879247 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:08.879247 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:08.879247 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:08.879247 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:08.879247 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:08.879247 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:08.879247 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:08.879247 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:08.879247 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:43:08.879247 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:43:08.879247 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:43:08.879247 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:43:08.880394 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:08.880394 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:08.880394 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:08.880394 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:08.880394 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:08.880394 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:08.880394 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:08.880394 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:08.880394 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:08.880394 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:08.880394 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:08.880394 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:08.880394 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:08.880394 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:08.880394 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:08.880394 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:08.880394 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:43:08.881228 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:43:08.881228 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:08.881228 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:08.881228 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 228/439] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:43:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:08.881228 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe19850-b383-4cfd-b63d-5bf895341923 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:08.941236 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585341c9-0ea6-4dea-90d4-5e4affc419ea None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:08.976564 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba62e5fd-0a0b-46c0-b83f-18ab79e2a321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:08.977168 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62e5fd-0a0b-46c0-b83f-18ab79e2a321 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:08.977453 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62e5fd-0a0b-46c0-b83f-18ab79e2a321 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:08.977733 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62e5fd-0a0b-46c0-b83f-18ab79e2a321 None admin] PATH_INFO: `/v3/domains` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:08.978405 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba62e5fd-0a0b-46c0-b83f-18ab79e2a321 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:08.978711 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba62e5fd-0a0b-46c0-b83f-18ab79e2a321 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:08.980092 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba62e5fd-0a0b-46c0-b83f-18ab79e2a321 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:08.992348 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 212/440] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:43:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:08.995336 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad9bc0-6e05-4075-a57f-e653d3b8f74e None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:08.995619 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad9bc0-6e05-4075-a57f-e653d3b8f74e None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:08.995891 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad9bc0-6e05-4075-a57f-e653d3b8f74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:09.001135 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe19850-b383-4cfd-b63d-5bf895341923 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:09.014262 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-abad9bc0-6e05-4075-a57f-e653d3b8f74e None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:09.015483 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-abad9bc0-6e05-4075-a57f-e653d3b8f74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:09.037902 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1e95f-1c00-4f4a-b744-3d448d1385ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:09.038550 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1e95f-1c00-4f4a-b744-3d448d1385ee None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:09.038824 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1e95f-1c00-4f4a-b744-3d448d1385ee None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:09.039089 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1e95f-1c00-4f4a-b744-3d448d1385ee None admin] PATH_INFO: `/v3/domains` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:09.039726 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c1e95f-1c00-4f4a-b744-3d448d1385ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:09.040024 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c1e95f-1c00-4f4a-b744-3d448d1385ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:09.041400 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c1e95f-1c00-4f4a-b744-3d448d1385ee None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:09.057536 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 229/441] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:43:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:09.057536 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1e95f-1c00-4f4a-b744-3d448d1385ee None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:09.091947 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:09.093078 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:09.110657 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 213/442] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:43:09.112062 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad9bc0-6e05-4075-a57f-e653d3b8f74e None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:09.177987 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1e95f-1c00-4f4a-b744-3d448d1385ee None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:09.215746 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4d16f-8c20-49e7-a1b0-fc6e0946f349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:09.216348 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4d16f-8c20-49e7-a1b0-fc6e0946f349 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:09.216624 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4d16f-8c20-49e7-a1b0-fc6e0946f349 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:09.216895 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4d16f-8c20-49e7-a1b0-fc6e0946f349 None admin] PATH_INFO: `/v3/domains` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:09.217539 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e4d16f-8c20-49e7-a1b0-fc6e0946f349 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:09.217838 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e4d16f-8c20-49e7-a1b0-fc6e0946f349 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:09.219245 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e4d16f-8c20-49e7-a1b0-fc6e0946f349 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:09.227691 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad9bc0-6e05-4075-a57f-e653d3b8f74e None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:09.233045 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 230/443] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:09.233975 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4d16f-8c20-49e7-a1b0-fc6e0946f349 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:09.269591 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b910f5-af0d-4ca6-96fc-7c1069950eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:09.270844 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b910f5-af0d-4ca6-96fc-7c1069950eb0 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:09.271135 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b910f5-af0d-4ca6-96fc-7c1069950eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:09.271408 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b910f5-af0d-4ca6-96fc-7c1069950eb0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:09.278412 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b910f5-af0d-4ca6-96fc-7c1069950eb0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:09.279870 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b910f5-af0d-4ca6-96fc-7c1069950eb0 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:09.292612 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-21b910f5-af0d-4ca6-96fc-7c1069950eb0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:43:09.292612 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:09.292612 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:09.292612 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:09.292612 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:09.292612 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:09.292612 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:09.292612 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:09.292612 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:09.292612 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:09.292612 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:09.292612 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:09.292612 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 00:43:09.292612 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 00:43:09.292612 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 00:43:09.293617 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 00:43:09.293617 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:09.293617 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:09.293617 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:09.293617 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:09.293617 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:09.293617 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:09.293617 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:09.293617 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:09.293617 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:09.293617 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:09.293617 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:09.293617 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:09.293617 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:09.293617 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:09.293617 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:09.293617 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:09.294557 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 00:43:09.294557 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 00:43:09.294557 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 00:43:09.294557 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 00:43:09.294557 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 00:43:09.294557 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 00:43:09.294557 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:43:09.294557 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:09.294557 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 214/444] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 23 00:43:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:09.295018 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed9736-86ee-4bc9-8544-aa32f88024bc None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:09.295134 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed9736-86ee-4bc9-8544-aa32f88024bc None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:09.295405 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed9736-86ee-4bc9-8544-aa32f88024bc None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:09.300678 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 215/445] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:43:09.300678 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed9736-86ee-4bc9-8544-aa32f88024bc None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:09.344031 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:09.353725 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4d16f-8c20-49e7-a1b0-fc6e0946f349 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:09.363551 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:09.388149 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae674524-bda3-4e58-a859-1b32270a2748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:09.388777 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae674524-bda3-4e58-a859-1b32270a2748 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:09.389059 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae674524-bda3-4e58-a859-1b32270a2748 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:09.389333 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae674524-bda3-4e58-a859-1b32270a2748 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:09.397257 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae674524-bda3-4e58-a859-1b32270a2748 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:09.398751 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae674524-bda3-4e58-a859-1b32270a2748 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:09.409555 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-ae674524-bda3-4e58-a859-1b32270a2748 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 23 00:43:09.409555 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:09.409555 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:09.409555 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:09.409555 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:09.409555 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:09.409555 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:09.409555 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:09.409555 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:09.409555 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:09.409555 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:09.409555 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:09.409555 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 00:43:09.409555 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 00:43:09.409555 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 00:43:09.409555 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 00:43:09.410532 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:09.410532 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:09.410532 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:43:09.410532 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:43:09.410532 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:43:09.410532 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:43:09.410532 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:09.410532 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:09.410532 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:09.410532 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:09.410532 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:09.410532 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:09.410532 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:09.410532 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:09.410532 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:09.410532 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:09.410532 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:09.410532 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:09.412082 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:09.412082 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:09.412082 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 00:43:09.412082 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 00:43:09.412082 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 00:43:09.412082 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 00:43:09.412082 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 00:43:09.412082 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 00:43:09.412082 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 23 00:43:09.412082 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:09.412082 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 231/446] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 23 00:43:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:09.412651 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed9736-86ee-4bc9-8544-aa32f88024bc None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:09.412728 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae674524-bda3-4e58-a859-1b32270a2748 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:09.445182 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a53231-a4f8-4c4e-952b-6e136912ad96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:09.445801 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a53231-a4f8-4c4e-952b-6e136912ad96 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:09.446098 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a53231-a4f8-4c4e-952b-6e136912ad96 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:09.446392 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a53231-a4f8-4c4e-952b-6e136912ad96 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:09.453568 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a53231-a4f8-4c4e-952b-6e136912ad96 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:09.455048 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a53231-a4f8-4c4e-952b-6e136912ad96 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:09.466564 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-d2a53231-a4f8-4c4e-952b-6e136912ad96 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 23 00:43:09.466564 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:09.466564 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:09.466564 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:09.466564 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:09.466564 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:09.466564 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:09.466564 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:09.466564 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:09.466564 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:09.466564 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:09.466564 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:09.466564 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 00:43:09.466564 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 00:43:09.466564 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 00:43:09.466564 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 00:43:09.467622 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:09.467622 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:09.467622 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:43:09.467622 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:43:09.467622 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:43:09.467622 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:43:09.467622 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:09.467622 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:09.467622 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:09.467622 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:09.467622 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:09.467622 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:09.467622 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:09.467622 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:09.467622 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:09.467622 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:09.467622 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:09.467622 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:09.468847 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:09.468847 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:09.468847 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 00:43:09.468847 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 00:43:09.468847 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 00:43:09.468847 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 00:43:09.468847 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 00:43:09.468847 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 00:43:09.468847 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 23 00:43:09.468847 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:09.468847 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 216/447] 10.222.0.23 () {56 vars in 1093 bytes} [Sun Oct 23 00:43:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:09.469528 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48e7d0-1e98-4c60-bbb0-a63294862571 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:09.469528 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48e7d0-1e98-4c60-bbb0-a63294862571 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:09.469666 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48e7d0-1e98-4c60-bbb0-a63294862571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:09.487840 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-3c48e7d0-1e98-4c60-bbb0-a63294862571 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:09.489060 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-3c48e7d0-1e98-4c60-bbb0-a63294862571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:09.513832 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae674524-bda3-4e58-a859-1b32270a2748 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:09.548520 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d43d2-9a63-495b-a254-8afc4d9cebe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:09.549128 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d43d2-9a63-495b-a254-8afc4d9cebe4 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:09.549413 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d43d2-9a63-495b-a254-8afc4d9cebe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:09.549683 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d43d2-9a63-495b-a254-8afc4d9cebe4 None admin] PATH_INFO: `/v3/projects` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:09.550407 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d43d2-9a63-495b-a254-8afc4d9cebe4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:09.550714 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d43d2-9a63-495b-a254-8afc4d9cebe4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:09.552168 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d43d2-9a63-495b-a254-8afc4d9cebe4 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:09.555243 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 217/448] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:43:09.556061 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c48e7d0-1e98-4c60-bbb0-a63294862571 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:09.571930 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 232/449] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 23 00:43:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:09.572614 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d43d2-9a63-495b-a254-8afc4d9cebe4 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:09.588645 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:09.608128 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:09.667754 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c48e7d0-1e98-4c60-bbb0-a63294862571 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:09.678366 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d43d2-9a63-495b-a254-8afc4d9cebe4 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:09.702850 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59afef-9caf-452d-b448-dcc176d92f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:09.703468 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59afef-9caf-452d-b448-dcc176d92f59 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:09.703745 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59afef-9caf-452d-b448-dcc176d92f59 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:09.704015 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59afef-9caf-452d-b448-dcc176d92f59 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:09.715446 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c5f0b6-2853-4581-a202-71f8bb6bba96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:09.716042 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5f0b6-2853-4581-a202-71f8bb6bba96 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:09.716152 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a59afef-9caf-452d-b448-dcc176d92f59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:43:09.716326 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5f0b6-2853-4581-a202-71f8bb6bba96 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:09.716589 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5f0b6-2853-4581-a202-71f8bb6bba96 None admin] PATH_INFO: `/v3/users` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:09.717314 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c5f0b6-2853-4581-a202-71f8bb6bba96 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:09.717622 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c5f0b6-2853-4581-a202-71f8bb6bba96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:09.719082 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c5f0b6-2853-4581-a202-71f8bb6bba96 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:09.721001 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-4a59afef-9caf-452d-b448-dcc176d92f59 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:43:09.721001 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:09.721001 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:09.721001 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:09.721001 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:09.721001 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:09.721001 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:09.721001 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:09.721001 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:09.721001 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:09.721001 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:09.721001 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:09.721001 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:43:09.721001 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:43:09.721001 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:43:09.721001 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:43:09.721861 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:43:09.721861 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:43:09.721861 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:43:09.721861 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:43:09.721861 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:09.721861 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:09.721861 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:09.721861 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:09.721861 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:09.721861 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:09.721861 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:09.721861 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:09.721861 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:09.721861 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:09.721861 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:09.721861 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:09.722688 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:09.722688 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:09.722688 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:09.722688 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:09.722688 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:43:09.722688 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:43:09.722688 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:43:09.722688 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:43:09.722688 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:43:09.722688 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:43:09.722688 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:43:09.722688 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:09.724580 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 218/450] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 23 00:43:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:09.725023 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59afef-9caf-452d-b448-dcc176d92f59 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:09.743280 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 233/451] 10.222.0.23 () {56 vars in 1135 bytes} [Sun Oct 23 00:43:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:09.743280 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c5f0b6-2853-4581-a202-71f8bb6bba96 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:09.811326 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:09.835537 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59afef-9caf-452d-b448-dcc176d92f59 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:09.843281 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:09.845280 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c5f0b6-2853-4581-a202-71f8bb6bba96 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:09.870174 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038c0ec-51e6-4a7b-bb2f-664b0254bab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:09.870770 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038c0ec-51e6-4a7b-bb2f-664b0254bab5 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:09.871054 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038c0ec-51e6-4a7b-bb2f-664b0254bab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:09.871327 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038c0ec-51e6-4a7b-bb2f-664b0254bab5 None admin] PATH_INFO: `/v3/users` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:09.872046 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f038c0ec-51e6-4a7b-bb2f-664b0254bab5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:09.872352 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f038c0ec-51e6-4a7b-bb2f-664b0254bab5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:09.873805 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f038c0ec-51e6-4a7b-bb2f-664b0254bab5 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:09.878984 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3973b06c-d679-4f6f-83d8-a4be4dd2c189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:09.880101 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973b06c-d679-4f6f-83d8-a4be4dd2c189 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:09.880382 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973b06c-d679-4f6f-83d8-a4be4dd2c189 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:09.880650 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973b06c-d679-4f6f-83d8-a4be4dd2c189 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:09.881360 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3973b06c-d679-4f6f-83d8-a4be4dd2c189 None admin] RBAC: Adding query filter params (role.id=832e4b25a75c4d30a010d6803a5a4577, scope.project.id=60f8594760e44ce3888a32702ea9afcc, user.id=1b94f1f12db3473f9ce1f33d2d9056a7) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:09.881662 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3973b06c-d679-4f6f-83d8-a4be4dd2c189 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:09.883114 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3973b06c-d679-4f6f-83d8-a4be4dd2c189 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:09.888944 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 234/452] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 23 00:43:09 2022] GET /identity/v3/role_assignments?user.id=1b94f1f12db3473f9ce1f33d2d9056a7&scope.project.id=60f8594760e44ce3888a32702ea9afcc&role.id=832e4b25a75c4d30a010d6803a5a4577 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:09.889709 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3973b06c-d679-4f6f-83d8-a4be4dd2c189 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:09.895023 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 219/453] 10.222.0.23 () {56 vars in 1133 bytes} [Sun Oct 23 00:43:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:09.895023 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038c0ec-51e6-4a7b-bb2f-664b0254bab5 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:10.005385 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3973b06c-d679-4f6f-83d8-a4be4dd2c189 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:10.006246 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038c0ec-51e6-4a7b-bb2f-664b0254bab5 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:10.043807 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35534621-a75c-4d2b-86f6-079eda6fdc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:10.044426 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35534621-a75c-4d2b-86f6-079eda6fdc41 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:10.044742 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35534621-a75c-4d2b-86f6-079eda6fdc41 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:10.044973 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35534621-a75c-4d2b-86f6-079eda6fdc41 None admin] PATH_INFO: `/v3/roles` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:10.045383 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7f8ac-cf30-46c7-aacb-53eb01cb1e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:10.045646 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35534621-a75c-4d2b-86f6-079eda6fdc41 None admin] RBAC: Adding query filter params (name=service) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:10.045949 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35534621-a75c-4d2b-86f6-079eda6fdc41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:10.046049 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7f8ac-cf30-46c7-aacb-53eb01cb1e92 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:10.046305 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7f8ac-cf30-46c7-aacb-53eb01cb1e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:10.046574 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7f8ac-cf30-46c7-aacb-53eb01cb1e92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:10.047385 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35534621-a75c-4d2b-86f6-079eda6fdc41 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:10.049115 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:10.057386 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 235/454] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Oct 23 00:43:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:10.058261 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35534621-a75c-4d2b-86f6-079eda6fdc41 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:10.059443 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c7f8ac-cf30-46c7-aacb-53eb01cb1e92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:10.061083 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c7f8ac-cf30-46c7-aacb-53eb01cb1e92 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:10.078201 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-c9c7f8ac-cf30-46c7-aacb-53eb01cb1e92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:10.078201 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:10.078201 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:10.078201 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:10.078201 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:10.078201 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:10.078201 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:10.078201 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:10.078201 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:10.078201 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:10.078201 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:10.078201 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:10.078201 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:43:10.078201 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:43:10.078201 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:43:10.078201 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:43:10.080176 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:10.080176 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:10.080176 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:10.080176 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:10.080176 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:10.080176 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:10.080176 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:10.080176 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:10.080176 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:10.080176 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:10.080176 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:10.080176 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:10.080176 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:10.080176 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:10.080176 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:10.080176 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:10.080176 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:43:10.081091 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:43:10.081091 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:10.081091 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:10.081091 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 220/455] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:43:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:10.081091 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7f8ac-cf30-46c7-aacb-53eb01cb1e92 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:10.099261 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:10.173073 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35534621-a75c-4d2b-86f6-079eda6fdc41 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:10.186866 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7f8ac-cf30-46c7-aacb-53eb01cb1e92 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:10.208386 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e93b6-e3de-4d75-b09b-c218fe95f64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:10.209016 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e93b6-e3de-4d75-b09b-c218fe95f64e None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:10.209699 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e93b6-e3de-4d75-b09b-c218fe95f64e None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:10.209978 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e93b6-e3de-4d75-b09b-c218fe95f64e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:10.219876 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2e93b6-e3de-4d75-b09b-c218fe95f64e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:43:10.225697 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-aa2e93b6-e3de-4d75-b09b-c218fe95f64e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:43:10.225697 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:10.225697 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:10.225697 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:10.225697 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:10.225697 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:10.225697 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:10.225697 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:10.225697 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:10.225697 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:10.225697 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:10.225697 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:10.225697 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:43:10.225697 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:43:10.225697 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:43:10.225697 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:43:10.232029 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:43:10.232029 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:43:10.232029 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:43:10.232029 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:43:10.232029 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:10.232029 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:10.232029 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:10.232029 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:10.232029 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:10.232029 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:10.232029 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:10.232029 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:10.232029 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:10.232029 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:10.232029 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:10.232029 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:10.232911 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:10.232911 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:10.232911 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:10.232911 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:10.232911 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:43:10.232911 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:43:10.232911 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:43:10.232911 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:43:10.232911 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:43:10.232911 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:43:10.232911 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:43:10.232911 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:10.232911 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 236/456] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 23 00:43:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:10.232911 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e93b6-e3de-4d75-b09b-c218fe95f64e None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:10.234150 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f51081-ad1c-4889-a436-f9db3298f72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:10.234150 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f51081-ad1c-4889-a436-f9db3298f72a None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:10.234150 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f51081-ad1c-4889-a436-f9db3298f72a None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:10.234150 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f51081-ad1c-4889-a436-f9db3298f72a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:10.287859 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:10.313020 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f51081-ad1c-4889-a436-f9db3298f72a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:10.314683 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f51081-ad1c-4889-a436-f9db3298f72a None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:10.333507 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:10.333658 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e93b6-e3de-4d75-b09b-c218fe95f64e None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:10.369128 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d40be8-20b6-4ec2-b283-b3cd6ec9be06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:10.369758 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d40be8-20b6-4ec2-b283-b3cd6ec9be06 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:10.370040 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d40be8-20b6-4ec2-b283-b3cd6ec9be06 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:10.370770 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d40be8-20b6-4ec2-b283-b3cd6ec9be06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:10.381512 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d40be8-20b6-4ec2-b283-b3cd6ec9be06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:10.382975 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d40be8-20b6-4ec2-b283-b3cd6ec9be06 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:10.397387 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-f6d40be8-20b6-4ec2-b283-b3cd6ec9be06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:10.397387 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:10.397387 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:10.397387 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:10.397387 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:10.397387 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:10.397387 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:10.397387 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:10.397387 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:10.397387 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:10.397387 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:10.397387 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:10.397387 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:43:10.397387 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:43:10.397387 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:43:10.397387 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:43:10.398539 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:10.398539 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:10.398539 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:10.398539 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:10.398539 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:10.398539 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:10.398539 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:10.398539 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:10.398539 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:10.398539 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:10.398539 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:10.398539 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:10.398539 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:10.398539 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:10.398539 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:10.398539 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:10.398539 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:43:10.400008 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:43:10.400008 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:10.400008 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:10.403221 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 237/457] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:43:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:10.403836 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d40be8-20b6-4ec2-b283-b3cd6ec9be06 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:10.427043 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 221/458] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 23 00:43:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 00:43:10.427898 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f51081-ad1c-4889-a436-f9db3298f72a None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:10.509037 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d40be8-20b6-4ec2-b283-b3cd6ec9be06 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:10.517831 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:10.537756 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f51081-ad1c-4889-a436-f9db3298f72a None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:10.543033 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c2240-cb82-428c-a389-a7033291aef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:10.543635 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c2240-cb82-428c-a389-a7033291aef9 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:10.543910 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c2240-cb82-428c-a389-a7033291aef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:10.544178 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c2240-cb82-428c-a389-a7033291aef9 None admin] PATH_INFO: `/v3/domains` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:10.544812 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c2240-cb82-428c-a389-a7033291aef9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:10.545109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c2240-cb82-428c-a389-a7033291aef9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:10.546515 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c2240-cb82-428c-a389-a7033291aef9 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:10.555703 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:10.559435 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 238/459] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:10.560393 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c2240-cb82-428c-a389-a7033291aef9 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:10.579487 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38516289-bc8b-410f-b818-406b147f82d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:10.580089 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38516289-bc8b-410f-b818-406b147f82d2 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:10.580395 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38516289-bc8b-410f-b818-406b147f82d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:10.580662 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38516289-bc8b-410f-b818-406b147f82d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:10.581320 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38516289-bc8b-410f-b818-406b147f82d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:10.581607 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38516289-bc8b-410f-b818-406b147f82d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:10.583021 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38516289-bc8b-410f-b818-406b147f82d2 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:10.591462 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 222/460] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Oct 23 00:43:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:10.592080 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38516289-bc8b-410f-b818-406b147f82d2 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:10.673658 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c2240-cb82-428c-a389-a7033291aef9 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:10.696197 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38516289-bc8b-410f-b818-406b147f82d2 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:10.710690 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b3466-9ded-4874-952a-57035634a3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:10.711705 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b3466-9ded-4874-952a-57035634a3d5 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:10.712174 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b3466-9ded-4874-952a-57035634a3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:10.712676 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b3466-9ded-4874-952a-57035634a3d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:10.713496 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756b3466-9ded-4874-952a-57035634a3d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:10.713991 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756b3466-9ded-4874-952a-57035634a3d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:10.715685 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756b3466-9ded-4874-952a-57035634a3d5 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:10.728930 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 239/461] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:10.730065 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b3466-9ded-4874-952a-57035634a3d5 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:10.733737 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ec0aa-0685-49b6-a2b8-7866b5c0b8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:10.734392 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ec0aa-0685-49b6-a2b8-7866b5c0b8ec None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:10.734669 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ec0aa-0685-49b6-a2b8-7866b5c0b8ec None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:10.734936 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ec0aa-0685-49b6-a2b8-7866b5c0b8ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:10.747212 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ec0aa-0685-49b6-a2b8-7866b5c0b8ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:10.748632 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ec0aa-0685-49b6-a2b8-7866b5c0b8ec None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:10.762234 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:10.762361 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-603ec0aa-0685-49b6-a2b8-7866b5c0b8ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:10.762361 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:10.762361 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:10.762361 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:10.762361 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:10.762361 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:10.762361 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:10.762361 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:10.762361 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:10.762361 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:10.762361 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:10.762361 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:10.762361 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:43:10.762361 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:43:10.762361 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:43:10.762361 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:43:10.763363 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:10.763363 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:10.763363 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:10.763363 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:10.763363 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:10.763363 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:10.763363 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:10.763363 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:10.763363 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:10.763363 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:10.763363 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:10.763363 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:10.763363 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:10.763363 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:10.763363 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:10.763363 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:10.763363 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:43:10.769410 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:43:10.769410 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:10.769410 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:10.769410 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 223/462] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:43:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:10.769410 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ec0aa-0685-49b6-a2b8-7866b5c0b8ec None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:10.802755 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:10.845662 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b3466-9ded-4874-952a-57035634a3d5 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:10.880676 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585a68d-1b75-4042-b534-8da775e03dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:10.881289 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585a68d-1b75-4042-b534-8da775e03dcc None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:10.881570 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585a68d-1b75-4042-b534-8da775e03dcc None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:10.881838 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585a68d-1b75-4042-b534-8da775e03dcc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:10.883015 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ec0aa-0685-49b6-a2b8-7866b5c0b8ec None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:10.888401 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e585a68d-1b75-4042-b534-8da775e03dcc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:10.889864 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e585a68d-1b75-4042-b534-8da775e03dcc None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:10.901451 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-e585a68d-1b75-4042-b534-8da775e03dcc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:43:10.901451 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:10.901451 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:10.901451 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:10.901451 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:10.901451 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:10.901451 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:10.901451 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:10.901451 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:10.901451 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:10.901451 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:10.901451 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:10.901451 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 00:43:10.901451 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 00:43:10.901451 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 00:43:10.902348 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 00:43:10.902348 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:10.902348 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:10.902348 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:10.902348 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:10.902348 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:10.902348 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:10.902348 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:10.902348 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:10.902348 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:10.902348 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:10.902348 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:10.902348 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:10.902348 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:10.902348 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:10.902348 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:10.902348 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:10.903248 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 00:43:10.903248 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 00:43:10.903248 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 00:43:10.903248 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 00:43:10.903248 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 00:43:10.903248 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 00:43:10.903248 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:43:10.903248 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:10.903248 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 240/463] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 23 00:43:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:10.903743 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585a68d-1b75-4042-b534-8da775e03dcc None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:10.924936 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef9a0e-b5ad-49ee-823c-e984216f3f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:10.925663 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef9a0e-b5ad-49ee-823c-e984216f3f10 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:10.926052 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef9a0e-b5ad-49ee-823c-e984216f3f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:10.926454 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef9a0e-b5ad-49ee-823c-e984216f3f10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:10.938596 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef9a0e-b5ad-49ee-823c-e984216f3f10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:10.940239 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef9a0e-b5ad-49ee-823c-e984216f3f10 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:10.956994 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-f7ef9a0e-b5ad-49ee-823c-e984216f3f10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:10.956994 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:10.956994 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:10.956994 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:10.956994 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:10.956994 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:10.956994 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:10.956994 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:10.956994 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:10.956994 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:10.956994 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:10.956994 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:10.956994 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:43:10.956994 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:43:10.956994 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:43:10.956994 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:43:10.958468 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:10.958468 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:10.958468 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:10.958468 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:10.958468 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:10.958468 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:10.958468 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:10.958468 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:10.958468 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:10.958468 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:10.958468 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:10.958468 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:10.958468 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:10.958468 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:10.958468 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:10.958468 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:10.958468 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:43:10.959311 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:43:10.959311 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:10.959311 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:10.959311 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 224/464] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:43:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:10.960069 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef9a0e-b5ad-49ee-823c-e984216f3f10 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:10.998811 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:11.011931 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585a68d-1b75-4042-b534-8da775e03dcc None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:11.049653 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47eaac0-f00b-4e09-b62a-9d6626e03aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:11.050415 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47eaac0-f00b-4e09-b62a-9d6626e03aad None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:11.050992 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47eaac0-f00b-4e09-b62a-9d6626e03aad None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:11.051125 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47eaac0-f00b-4e09-b62a-9d6626e03aad None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:11.051687 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:11.060830 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47eaac0-f00b-4e09-b62a-9d6626e03aad None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:11.062330 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47eaac0-f00b-4e09-b62a-9d6626e03aad None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:11.069581 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef9a0e-b5ad-49ee-823c-e984216f3f10 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:11.074203 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-d47eaac0-f00b-4e09-b62a-9d6626e03aad None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 23 00:43:11.074203 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:11.074203 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:11.074203 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:11.074203 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:11.074203 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:11.074203 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:11.074203 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:11.074203 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:11.074203 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:11.074203 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:11.074203 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:11.074203 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 00:43:11.074203 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 00:43:11.074203 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 00:43:11.074203 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 00:43:11.075273 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:11.075273 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:11.075273 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:43:11.075273 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:43:11.075273 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:43:11.075273 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:43:11.075273 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:11.075273 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:11.075273 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:11.075273 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:11.075273 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:11.075273 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:11.075273 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:11.075273 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:11.075273 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:11.075273 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:11.075273 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:11.075273 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:11.081571 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:11.081571 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:11.081571 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 00:43:11.081571 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 00:43:11.081571 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 00:43:11.081571 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 00:43:11.081571 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 00:43:11.081571 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 00:43:11.081571 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 23 00:43:11.081571 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:11.081571 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 241/465] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 23 00:43:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:11.081571 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47eaac0-f00b-4e09-b62a-9d6626e03aad None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:11.113156 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7010789-a564-4590-b199-eb9608eecf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:11.113749 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7010789-a564-4590-b199-eb9608eecf84 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:11.114048 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7010789-a564-4590-b199-eb9608eecf84 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:11.114344 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7010789-a564-4590-b199-eb9608eecf84 None admin] PATH_INFO: `/v3/domains` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:11.114971 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7010789-a564-4590-b199-eb9608eecf84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:11.115264 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7010789-a564-4590-b199-eb9608eecf84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:11.116633 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7010789-a564-4590-b199-eb9608eecf84 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:11.133018 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 225/466] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:11.134060 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7010789-a564-4590-b199-eb9608eecf84 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:11.182858 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47eaac0-f00b-4e09-b62a-9d6626e03aad None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:11.217215 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380aca9-c304-4d87-82cc-10e3ad1002aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:11.217711 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380aca9-c304-4d87-82cc-10e3ad1002aa None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:11.217991 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380aca9-c304-4d87-82cc-10e3ad1002aa None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:11.218308 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380aca9-c304-4d87-82cc-10e3ad1002aa None admin] PATH_INFO: `/v3/projects` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:11.219008 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a380aca9-c304-4d87-82cc-10e3ad1002aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:11.219311 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a380aca9-c304-4d87-82cc-10e3ad1002aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:11.220760 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a380aca9-c304-4d87-82cc-10e3ad1002aa None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:11.239876 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 242/467] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 23 00:43:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:11.239876 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380aca9-c304-4d87-82cc-10e3ad1002aa None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:11.251972 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:11.259776 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7010789-a564-4590-b199-eb9608eecf84 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:11.294268 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd474a-aea3-45d8-8102-7493d4562f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:11.294875 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd474a-aea3-45d8-8102-7493d4562f95 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:11.295149 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd474a-aea3-45d8-8102-7493d4562f95 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:11.295422 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd474a-aea3-45d8-8102-7493d4562f95 None admin] PATH_INFO: `/v3/domains` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:11.296054 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd474a-aea3-45d8-8102-7493d4562f95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:11.296354 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd474a-aea3-45d8-8102-7493d4562f95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:11.297720 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd474a-aea3-45d8-8102-7493d4562f95 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:11.314393 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 226/468] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:11.314393 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd474a-aea3-45d8-8102-7493d4562f95 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:11.316647 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:11.352397 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380aca9-c304-4d87-82cc-10e3ad1002aa None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:11.389639 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb730115-f08f-4a7d-99db-6331f705086b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:11.390304 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb730115-f08f-4a7d-99db-6331f705086b None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:11.390570 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb730115-f08f-4a7d-99db-6331f705086b None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:11.390842 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb730115-f08f-4a7d-99db-6331f705086b None admin] PATH_INFO: `/v3/users` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:11.391562 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb730115-f08f-4a7d-99db-6331f705086b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:11.391895 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb730115-f08f-4a7d-99db-6331f705086b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:11.393341 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb730115-f08f-4a7d-99db-6331f705086b None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:11.411269 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 243/469] 10.222.0.23 () {56 vars in 1137 bytes} [Sun Oct 23 00:43:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:11.412044 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb730115-f08f-4a7d-99db-6331f705086b None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:11.425672 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd474a-aea3-45d8-8102-7493d4562f95 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:11.460781 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d964ce-decb-4a57-b7a8-7908b8700236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:11.461404 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d964ce-decb-4a57-b7a8-7908b8700236 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:11.461693 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d964ce-decb-4a57-b7a8-7908b8700236 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:11.461949 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d964ce-decb-4a57-b7a8-7908b8700236 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:11.469120 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d964ce-decb-4a57-b7a8-7908b8700236 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:11.470698 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d964ce-decb-4a57-b7a8-7908b8700236 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:11.481676 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:11.483878 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-81d964ce-decb-4a57-b7a8-7908b8700236 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:43:11.483878 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:11.483878 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:11.483878 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:11.483878 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:11.483878 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:11.483878 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:11.483878 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:11.483878 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:11.483878 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:11.483878 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:11.483878 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:11.483878 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 00:43:11.483878 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 00:43:11.483878 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 00:43:11.484699 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 00:43:11.484699 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:11.484699 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:11.484699 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:11.484699 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:11.484699 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:11.484699 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:11.484699 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:11.484699 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:11.484699 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:11.484699 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:11.484699 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:11.484699 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:11.484699 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:11.484699 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:11.484699 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:11.484699 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:11.485574 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 00:43:11.485574 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 00:43:11.485574 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 00:43:11.485574 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 00:43:11.485574 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 00:43:11.485574 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 00:43:11.485574 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:43:11.485574 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:11.485574 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 227/470] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 23 00:43:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:11.486664 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d964ce-decb-4a57-b7a8-7908b8700236 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:11.525016 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb730115-f08f-4a7d-99db-6331f705086b None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:11.552307 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:11.559315 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c16936-4139-40c9-ae18-8d21c3fbb122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:11.559977 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c16936-4139-40c9-ae18-8d21c3fbb122 None admin] REQUEST_METHOD: `PUT` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:11.560258 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c16936-4139-40c9-ae18-8d21c3fbb122 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:11.560538 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c16936-4139-40c9-ae18-8d21c3fbb122 None admin] PATH_INFO: `/v3/projects/60f8594760e44ce3888a32702ea9afcc/users/84a0345be05644e3a7a71c5a2bf21c41/roles/832e4b25a75c4d30a010d6803a5a4577` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:11.576465 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c16936-4139-40c9-ae18-8d21c3fbb122 None admin] RBAC: Authorizing `identity:create_grant(project_id=60f8594760e44ce3888a32702ea9afcc, user_id=84a0345be05644e3a7a71c5a2bf21c41, role_id=832e4b25a75c4d30a010d6803a5a4577)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:11.578150 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c16936-4139-40c9-ae18-8d21c3fbb122 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:11.591354 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 244/471] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 23 00:43:11 2022] PUT /identity/v3/projects/60f8594760e44ce3888a32702ea9afcc/users/84a0345be05644e3a7a71c5a2bf21c41/roles/832e4b25a75c4d30a010d6803a5a4577 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:43:11.592361 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c16936-4139-40c9-ae18-8d21c3fbb122 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:11.610455 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d964ce-decb-4a57-b7a8-7908b8700236 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:11.653924 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d31ed5-d82e-45fa-b81d-486cedbed627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:11.654941 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d31ed5-d82e-45fa-b81d-486cedbed627 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:11.655468 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d31ed5-d82e-45fa-b81d-486cedbed627 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:11.655987 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d31ed5-d82e-45fa-b81d-486cedbed627 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:11.665646 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d31ed5-d82e-45fa-b81d-486cedbed627 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:11.667687 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d31ed5-d82e-45fa-b81d-486cedbed627 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:11.682456 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-77d31ed5-d82e-45fa-b81d-486cedbed627 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 23 00:43:11.682456 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:11.682456 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:11.682456 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:11.682456 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:11.682456 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:11.682456 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:11.682456 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:11.682456 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:11.682456 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:11.682456 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:11.682456 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:11.682456 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 00:43:11.682456 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 00:43:11.682456 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 00:43:11.682456 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 00:43:11.683434 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:11.683434 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:11.683434 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:43:11.683434 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:43:11.683434 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:43:11.683434 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:43:11.683434 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:11.683434 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:11.683434 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:11.683434 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:11.683434 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:11.683434 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:11.683434 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:11.683434 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:11.683434 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:11.683434 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:11.683434 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:11.683434 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:11.684361 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:11.684361 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:11.684361 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 00:43:11.684361 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 00:43:11.684361 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 00:43:11.684361 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 00:43:11.684361 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 00:43:11.684361 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 00:43:11.684361 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 23 00:43:11.684361 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:11.687132 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 228/472] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 23 00:43:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:11.688196 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d31ed5-d82e-45fa-b81d-486cedbed627 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:11.731387 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c16936-4139-40c9-ae18-8d21c3fbb122 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:11.761076 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:11.786614 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f8bcf6-8993-44c6-b9f1-34551325f61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:11.787948 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8bcf6-8993-44c6-b9f1-34551325f61b None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:11.788305 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8bcf6-8993-44c6-b9f1-34551325f61b None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:11.788651 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8bcf6-8993-44c6-b9f1-34551325f61b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:11.816099 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d31ed5-d82e-45fa-b81d-486cedbed627 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:11.843315 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:11.859466 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000ff24-533b-4f86-91b5-5b69118dc775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:11.860848 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000ff24-533b-4f86-91b5-5b69118dc775 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:11.861281 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000ff24-533b-4f86-91b5-5b69118dc775 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:11.861749 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000ff24-533b-4f86-91b5-5b69118dc775 None admin] PATH_INFO: `/v3/projects` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:11.863091 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1000ff24-533b-4f86-91b5-5b69118dc775 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:11.863850 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1000ff24-533b-4f86-91b5-5b69118dc775 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:11.865975 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1000ff24-533b-4f86-91b5-5b69118dc775 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:11.870322 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f8bcf6-8993-44c6-b9f1-34551325f61b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:11.871788 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f8bcf6-8993-44c6-b9f1-34551325f61b None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:11.884057 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 229/473] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 23 00:43:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:11.885558 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000ff24-533b-4f86-91b5-5b69118dc775 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:12.001321 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 245/474] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 23 00:43:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 00:43:12.002632 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f8bcf6-8993-44c6-b9f1-34551325f61b None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:12.013881 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000ff24-533b-4f86-91b5-5b69118dc775 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:12.050322 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d31965-1b19-4e8d-9d74-9b416e240dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:12.051194 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d31965-1b19-4e8d-9d74-9b416e240dc7 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:12.051194 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d31965-1b19-4e8d-9d74-9b416e240dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:12.052071 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d31965-1b19-4e8d-9d74-9b416e240dc7 None admin] PATH_INFO: `/v3/users` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:12.052625 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:12.053259 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d31965-1b19-4e8d-9d74-9b416e240dc7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:12.053710 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d31965-1b19-4e8d-9d74-9b416e240dc7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:12.055424 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d31965-1b19-4e8d-9d74-9b416e240dc7 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:12.078392 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 230/475] 10.222.0.23 () {56 vars in 1139 bytes} [Sun Oct 23 00:43:11 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:12.079600 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d31965-1b19-4e8d-9d74-9b416e240dc7 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:12.116999 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f8bcf6-8993-44c6-b9f1-34551325f61b None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:12.123393 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:12.155431 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae0aea-3b60-4187-af55-757c316dfc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:12.156189 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae0aea-3b60-4187-af55-757c316dfc4c None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:12.156586 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae0aea-3b60-4187-af55-757c316dfc4c None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:12.156953 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae0aea-3b60-4187-af55-757c316dfc4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:12.157774 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae0aea-3b60-4187-af55-757c316dfc4c None admin] RBAC: Adding query filter params (role.id=832e4b25a75c4d30a010d6803a5a4577, scope.project.id=60f8594760e44ce3888a32702ea9afcc, user.id=90f691140a8341ada73a8c6f01ad798c) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:12.158225 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae0aea-3b60-4187-af55-757c316dfc4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:12.159820 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae0aea-3b60-4187-af55-757c316dfc4c None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:12.170222 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 246/476] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 23 00:43:12 2022] GET /identity/v3/role_assignments?user.id=90f691140a8341ada73a8c6f01ad798c&scope.project.id=60f8594760e44ce3888a32702ea9afcc&role.id=832e4b25a75c4d30a010d6803a5a4577 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:12.170222 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae0aea-3b60-4187-af55-757c316dfc4c None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:12.197995 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d31965-1b19-4e8d-9d74-9b416e240dc7 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:12.249417 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5e843-d169-4ce3-9fa8-33d4b750cba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:12.250364 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5e843-d169-4ce3-9fa8-33d4b750cba1 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:12.250849 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5e843-d169-4ce3-9fa8-33d4b750cba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:12.251258 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5e843-d169-4ce3-9fa8-33d4b750cba1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:12.265456 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac5e843-d169-4ce3-9fa8-33d4b750cba1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:12.267545 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac5e843-d169-4ce3-9fa8-33d4b750cba1 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:12.287495 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-9ac5e843-d169-4ce3-9fa8-33d4b750cba1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:12.287495 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:12.287495 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:12.287495 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:12.287495 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:12.287495 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:12.287495 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:12.287495 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:12.287495 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:12.287495 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:12.287495 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:12.287495 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:12.287495 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:43:12.287495 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:43:12.287495 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:43:12.287495 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:43:12.288657 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:12.288657 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:12.288657 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:12.288657 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:12.288657 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:12.288657 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:12.288657 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:12.288657 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:12.288657 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:12.288657 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:12.288657 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:12.288657 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:12.288657 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:12.288657 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:12.288657 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:12.288657 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:12.288657 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:43:12.289680 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:43:12.289680 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:12.289680 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:12.296641 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 231/477] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:43:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:12.296641 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8de7c-e443-4750-a3bb-71589139427f None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:12.296641 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8de7c-e443-4750-a3bb-71589139427f None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:12.296641 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8de7c-e443-4750-a3bb-71589139427f None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:12.296641 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 232/478] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:43:12.298758 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c8de7c-e443-4750-a3bb-71589139427f None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:12.300923 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:12.334186 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae0aea-3b60-4187-af55-757c316dfc4c None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:12.388206 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d2590b-15bc-465f-a54e-818964cdd852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:12.388206 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2590b-15bc-465f-a54e-818964cdd852 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:12.388516 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2590b-15bc-465f-a54e-818964cdd852 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:12.388600 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2590b-15bc-465f-a54e-818964cdd852 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:12.419477 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:12.433039 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c8de7c-e443-4750-a3bb-71589139427f None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:12.467960 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d2590b-15bc-465f-a54e-818964cdd852 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:12.469797 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d2590b-15bc-465f-a54e-818964cdd852 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:12.471649 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d812fc79-70f0-4820-8dec-f148bd9917f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:12.472514 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812fc79-70f0-4820-8dec-f148bd9917f1 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:12.472803 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812fc79-70f0-4820-8dec-f148bd9917f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:12.473074 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812fc79-70f0-4820-8dec-f148bd9917f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:12.474678 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d812fc79-70f0-4820-8dec-f148bd9917f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:12.474988 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d812fc79-70f0-4820-8dec-f148bd9917f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:12.476349 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d812fc79-70f0-4820-8dec-f148bd9917f1 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:12.497947 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 233/479] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:12.497947 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c83634-8ef4-4ea6-8e81-c55bd02f3d39 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:12.497947 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c83634-8ef4-4ea6-8e81-c55bd02f3d39 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:12.497947 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c83634-8ef4-4ea6-8e81-c55bd02f3d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:12.521376 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-59c83634-8ef4-4ea6-8e81-c55bd02f3d39 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:12.522946 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-59c83634-8ef4-4ea6-8e81-c55bd02f3d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:12.582408 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:12.599052 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 234/480] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:43:12.600216 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c83634-8ef4-4ea6-8e81-c55bd02f3d39 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:12.624832 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 247/481] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 23 00:43:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 00:43:12.626316 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d2590b-15bc-465f-a54e-818964cdd852 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:12.755901 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:12.772798 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c83634-8ef4-4ea6-8e81-c55bd02f3d39 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:12.810951 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a8e48-fad6-487c-aa52-643bfd7bd6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:12.811683 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a8e48-fad6-487c-aa52-643bfd7bd6d1 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:12.812040 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a8e48-fad6-487c-aa52-643bfd7bd6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:12.812387 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a8e48-fad6-487c-aa52-643bfd7bd6d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:12.820264 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a8e48-fad6-487c-aa52-643bfd7bd6d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:12.821890 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a8e48-fad6-487c-aa52-643bfd7bd6d1 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:12.834772 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-fc3a8e48-fad6-487c-aa52-643bfd7bd6d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:43:12.834772 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:12.834772 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:12.834772 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:12.834772 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:12.834772 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:12.834772 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:12.834772 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:12.834772 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:12.834772 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:12.834772 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:12.834772 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:12.834772 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 00:43:12.834772 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 00:43:12.834772 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 00:43:12.835610 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 00:43:12.835610 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:12.835610 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:12.835610 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:12.835610 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:12.835610 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:12.835610 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:12.835610 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:12.835610 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:12.835610 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:12.835610 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:12.835610 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:12.835610 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:12.835610 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:12.835610 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:12.835610 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:12.835610 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:12.836441 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 00:43:12.836441 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 00:43:12.836441 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 00:43:12.836441 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 00:43:12.836441 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 00:43:12.836441 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 00:43:12.836441 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:43:12.836441 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:12.836441 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 235/482] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 23 00:43:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:12.836900 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d2590b-15bc-465f-a54e-818964cdd852 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:12.841564 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a8e48-fad6-487c-aa52-643bfd7bd6d1 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:12.930061 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ffa2d-e154-4bbc-930a-4879219b4145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:12.930752 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ffa2d-e154-4bbc-930a-4879219b4145 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:12.931004 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ffa2d-e154-4bbc-930a-4879219b4145 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:12.931281 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ffa2d-e154-4bbc-930a-4879219b4145 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:12.942457 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0ffa2d-e154-4bbc-930a-4879219b4145 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:12.943927 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0ffa2d-e154-4bbc-930a-4879219b4145 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:12.956234 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a8e48-fad6-487c-aa52-643bfd7bd6d1 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:12.959555 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-6e0ffa2d-e154-4bbc-930a-4879219b4145 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:12.959555 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:12.959555 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:12.959555 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:12.959555 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:12.959555 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:12.959555 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:12.959555 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:12.959555 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:12.959555 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:12.959555 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:12.959555 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:12.959555 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:43:12.959555 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:43:12.959555 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:43:12.959555 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:43:12.960622 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:12.960622 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:12.960622 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:12.960622 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:12.960622 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:12.960622 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:12.960622 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:12.960622 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:12.960622 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:12.960622 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:12.960622 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:12.960622 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:12.960622 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:12.960622 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:12.960622 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:12.960622 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:12.960622 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:43:12.961758 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:43:12.961758 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:12.961758 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:12.961758 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 248/483] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:43:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:43:12.961758 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ffa2d-e154-4bbc-930a-4879219b4145 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:12.995266 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:13.001417 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12e39e-b6e6-43fc-b46c-0c76031edc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:13.002362 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12e39e-b6e6-43fc-b46c-0c76031edc13 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:13.003228 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12e39e-b6e6-43fc-b46c-0c76031edc13 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:13.003864 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12e39e-b6e6-43fc-b46c-0c76031edc13 None admin] PATH_INFO: `/v3/projects` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:13.004974 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d12e39e-b6e6-43fc-b46c-0c76031edc13 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:13.005433 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d12e39e-b6e6-43fc-b46c-0c76031edc13 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:13.007528 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d12e39e-b6e6-43fc-b46c-0c76031edc13 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:13.027136 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 236/484] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 23 00:43:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:13.028758 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12e39e-b6e6-43fc-b46c-0c76031edc13 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:13.062443 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:13.073777 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ffa2d-e154-4bbc-930a-4879219b4145 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:13.109882 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f000c21a-ac58-44f9-b458-cfebaa69b51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:13.110897 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f000c21a-ac58-44f9-b458-cfebaa69b51a None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:13.111012 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f000c21a-ac58-44f9-b458-cfebaa69b51a None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:13.111405 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f000c21a-ac58-44f9-b458-cfebaa69b51a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:13.123392 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f000c21a-ac58-44f9-b458-cfebaa69b51a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:13.124929 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f000c21a-ac58-44f9-b458-cfebaa69b51a None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:13.139626 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-f000c21a-ac58-44f9-b458-cfebaa69b51a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:13.139626 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:13.139626 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:13.139626 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:13.139626 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:13.139626 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:13.139626 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:13.139626 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:13.139626 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:13.139626 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:13.139626 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:13.139626 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:13.139626 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:43:13.139626 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:43:13.139626 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:43:13.139626 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:43:13.140720 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:13.140720 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:13.140720 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:13.140720 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:13.140720 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:13.140720 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:13.140720 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:13.140720 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:13.140720 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:13.140720 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:13.140720 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:13.140720 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:13.140720 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:13.140720 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:13.140720 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:13.140720 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:13.140720 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:43:13.141829 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:43:13.141829 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:13.141829 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:13.143247 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 249/485] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:43:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:13.144253 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f000c21a-ac58-44f9-b458-cfebaa69b51a None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:13.147596 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12e39e-b6e6-43fc-b46c-0c76031edc13 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:13.187367 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfdb0fe-9296-4653-96a7-27b50d87c13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:13.188150 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdb0fe-9296-4653-96a7-27b50d87c13b None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:13.189417 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdb0fe-9296-4653-96a7-27b50d87c13b None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:13.189880 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdb0fe-9296-4653-96a7-27b50d87c13b None admin] PATH_INFO: `/v3/domains` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:13.190701 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfdb0fe-9296-4653-96a7-27b50d87c13b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:13.191155 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfdb0fe-9296-4653-96a7-27b50d87c13b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:13.193262 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfdb0fe-9296-4653-96a7-27b50d87c13b None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:13.210575 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 237/486] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:43:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:13.211679 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfdb0fe-9296-4653-96a7-27b50d87c13b None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:13.254244 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:13.277504 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f000c21a-ac58-44f9-b458-cfebaa69b51a None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:13.294560 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:13.328784 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1849fa79-8912-4e59-84d2-45af405b45d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:13.329636 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849fa79-8912-4e59-84d2-45af405b45d3 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:13.330068 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849fa79-8912-4e59-84d2-45af405b45d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:13.330540 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849fa79-8912-4e59-84d2-45af405b45d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:13.332083 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1849fa79-8912-4e59-84d2-45af405b45d3 None admin] RBAC: Adding query filter params (role.id=832e4b25a75c4d30a010d6803a5a4577, scope.project.id=60f8594760e44ce3888a32702ea9afcc, user.id=57aa88f06f88438c8f0d4d2e65be71c0) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:13.333222 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1849fa79-8912-4e59-84d2-45af405b45d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:13.335265 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1849fa79-8912-4e59-84d2-45af405b45d3 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:13.350129 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfdb0fe-9296-4653-96a7-27b50d87c13b None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:13.351394 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 250/487] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 23 00:43:13 2022] GET /identity/v3/role_assignments?user.id=57aa88f06f88438c8f0d4d2e65be71c0&scope.project.id=60f8594760e44ce3888a32702ea9afcc&role.id=832e4b25a75c4d30a010d6803a5a4577 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:13.352653 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1849fa79-8912-4e59-84d2-45af405b45d3 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:13.423325 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c914432-c343-4a89-a9e9-15cfd3053d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:13.424449 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c914432-c343-4a89-a9e9-15cfd3053d8c None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:13.425603 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c914432-c343-4a89-a9e9-15cfd3053d8c None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:13.426309 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c914432-c343-4a89-a9e9-15cfd3053d8c None admin] PATH_INFO: `/v3/domains` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:13.427909 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c914432-c343-4a89-a9e9-15cfd3053d8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:13.428660 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c914432-c343-4a89-a9e9-15cfd3053d8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:13.432716 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c914432-c343-4a89-a9e9-15cfd3053d8c None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:13.458836 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 238/488] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:43:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:13.464892 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c914432-c343-4a89-a9e9-15cfd3053d8c None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:13.575863 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1849fa79-8912-4e59-84d2-45af405b45d3 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:13.621164 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb20812-3820-4b50-91ca-bdc7619730db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:13.621806 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb20812-3820-4b50-91ca-bdc7619730db None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:13.622105 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb20812-3820-4b50-91ca-bdc7619730db None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:13.622385 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb20812-3820-4b50-91ca-bdc7619730db None admin] PATH_INFO: `/v3/projects/service` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:13.627321 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c914432-c343-4a89-a9e9-15cfd3053d8c None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:13.633070 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb20812-3820-4b50-91ca-bdc7619730db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:13.634583 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb20812-3820-4b50-91ca-bdc7619730db None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:13.651614 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-afb20812-3820-4b50-91ca-bdc7619730db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:43:13.651614 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:13.651614 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:13.651614 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:13.651614 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:13.651614 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:13.651614 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:13.651614 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:13.651614 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:13.651614 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:13.651614 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:13.651614 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:13.651614 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 00:43:13.651614 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 00:43:13.651614 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 00:43:13.652526 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 00:43:13.652526 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:13.652526 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:13.652526 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:13.652526 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:13.652526 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:13.652526 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:13.652526 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:13.652526 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:13.652526 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:13.652526 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:13.652526 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:13.652526 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:13.652526 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:13.652526 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:13.652526 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:13.652526 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:13.654002 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 00:43:13.654002 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 00:43:13.654002 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 00:43:13.654002 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 00:43:13.654002 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 00:43:13.654002 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 00:43:13.654002 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:43:13.654002 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:13.654002 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 251/489] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 23 00:43:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:13.659249 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb20812-3820-4b50-91ca-bdc7619730db None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:13.664614 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:13.681444 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde7e2f-6d38-4c59-81cd-046fc74f75e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:13.682466 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:13.682998 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde7e2f-6d38-4c59-81cd-046fc74f75e2 None admin] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:13.683483 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde7e2f-6d38-4c59-81cd-046fc74f75e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:13.683960 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde7e2f-6d38-4c59-81cd-046fc74f75e2 None admin] PATH_INFO: `/v3/users` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:13.684880 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edde7e2f-6d38-4c59-81cd-046fc74f75e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:13.687222 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edde7e2f-6d38-4c59-81cd-046fc74f75e2 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:13.726794 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 239/490] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 23 00:43:13 2022] POST /identity/v3/users => generated 254 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:43:13.790586 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb20812-3820-4b50-91ca-bdc7619730db None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:13.830453 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51f527-f3d3-4e9a-8b1f-1aa90a2dd00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:13.830986 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51f527-f3d3-4e9a-8b1f-1aa90a2dd00a None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:13.831268 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51f527-f3d3-4e9a-8b1f-1aa90a2dd00a None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:13.831539 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51f527-f3d3-4e9a-8b1f-1aa90a2dd00a None admin] PATH_INFO: `/v3/projects` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:13.832231 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d51f527-f3d3-4e9a-8b1f-1aa90a2dd00a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:13.832537 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d51f527-f3d3-4e9a-8b1f-1aa90a2dd00a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:13.834565 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d51f527-f3d3-4e9a-8b1f-1aa90a2dd00a None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:13.847945 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 252/491] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 23 00:43:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:43:13.854015 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde7e2f-6d38-4c59-81cd-046fc74f75e2 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:13.990230 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde7e2f-6d38-4c59-81cd-046fc74f75e2 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:14.025358 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e98378e-05eb-4a0c-804a-d76b6fb29797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:14.025957 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98378e-05eb-4a0c-804a-d76b6fb29797 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:14.026272 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98378e-05eb-4a0c-804a-d76b6fb29797 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:14.026550 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98378e-05eb-4a0c-804a-d76b6fb29797 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:14.027267 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e98378e-05eb-4a0c-804a-d76b6fb29797 None admin] RBAC: Adding query filter params (role.id=832e4b25a75c4d30a010d6803a5a4577, scope.project.id=60f8594760e44ce3888a32702ea9afcc, user.id=04804cfc28b84d398ef06e8e113a755d) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:14.027573 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e98378e-05eb-4a0c-804a-d76b6fb29797 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:14.029007 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e98378e-05eb-4a0c-804a-d76b6fb29797 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:14.036641 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 240/492] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 23 00:43:13 2022] GET /identity/v3/role_assignments?user.id=04804cfc28b84d398ef06e8e113a755d&scope.project.id=60f8594760e44ce3888a32702ea9afcc&role.id=832e4b25a75c4d30a010d6803a5a4577 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:14.083831 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e69b97-c4f3-45a1-be16-6ee843d80df9 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:14.084327 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e69b97-c4f3-45a1-be16-6ee843d80df9 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:14.084327 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e69b97-c4f3-45a1-be16-6ee843d80df9 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:14.085962 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 253/493] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:43:14.091712 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934bf9a-79dd-4b2b-ab68-0103b1c1c988 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:14.092237 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934bf9a-79dd-4b2b-ab68-0103b1c1c988 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:14.092330 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934bf9a-79dd-4b2b-ab68-0103b1c1c988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:14.115867 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-d934bf9a-79dd-4b2b-ab68-0103b1c1c988 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:14.117096 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-d934bf9a-79dd-4b2b-ab68-0103b1c1c988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:14.156819 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:14.198828 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 241/494] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 00:43:14.479710 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e69b97-c4f3-45a1-be16-6ee843d80df9 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:14.579431 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:14.618666 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a73cb-838b-4c38-b3f4-98b7b52be184 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:14.619029 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a73cb-838b-4c38-b3f4-98b7b52be184 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:14.619225 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a73cb-838b-4c38-b3f4-98b7b52be184 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:14.621239 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 242/495] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:43:14.626440 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61514353-611d-4429-9855-a48a0227df46 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:14.626728 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61514353-611d-4429-9855-a48a0227df46 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:14.627002 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61514353-611d-4429-9855-a48a0227df46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:14.638012 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e69b97-c4f3-45a1-be16-6ee843d80df9 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:14.667040 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-61514353-611d-4429-9855-a48a0227df46 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:14.671832 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-61514353-611d-4429-9855-a48a0227df46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:14.706833 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95697372-f51b-4287-8fb7-e557fdecef4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:14.707476 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95697372-f51b-4287-8fb7-e557fdecef4b None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:14.708359 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95697372-f51b-4287-8fb7-e557fdecef4b None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:14.708641 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95697372-f51b-4287-8fb7-e557fdecef4b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:14.727437 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95697372-f51b-4287-8fb7-e557fdecef4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:43:14.737857 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-95697372-f51b-4287-8fb7-e557fdecef4b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:43:14.737857 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:14.737857 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:14.737857 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:14.737857 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:14.737857 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:14.737857 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:14.737857 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:14.737857 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:14.737857 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:14.737857 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:14.737857 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:14.737857 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:43:14.737857 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:43:14.737857 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:43:14.737857 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:43:14.739290 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:43:14.739290 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:43:14.739290 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:43:14.739290 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:43:14.739290 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:14.739290 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:14.739290 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:14.739290 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:14.739290 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:14.739290 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:14.739290 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:14.739290 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:14.739290 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:14.739290 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:14.739290 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:14.739290 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:14.740240 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:14.740240 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:14.740240 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:14.740240 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:14.740240 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:43:14.740240 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:43:14.740240 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:43:14.740240 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:43:14.740240 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:43:14.740240 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:43:14.740240 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:43:14.740240 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:14.740240 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 254/496] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 23 00:43:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:14.752920 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95697372-f51b-4287-8fb7-e557fdecef4b None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:14.792936 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 243/497] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 00:43:14.885045 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95697372-f51b-4287-8fb7-e557fdecef4b None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:14.913969 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:14.922822 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e89ed8-81bc-4240-b909-84d9de659b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:14.923428 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e89ed8-81bc-4240-b909-84d9de659b6c None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:14.923704 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e89ed8-81bc-4240-b909-84d9de659b6c None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:14.923975 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e89ed8-81bc-4240-b909-84d9de659b6c None admin] PATH_INFO: `/v3/roles` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:14.924689 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e89ed8-81bc-4240-b909-84d9de659b6c None admin] RBAC: Adding query filter params (name=service) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:14.924987 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e89ed8-81bc-4240-b909-84d9de659b6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:14.926478 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e89ed8-81bc-4240-b909-84d9de659b6c None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:14.935208 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 255/498] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Oct 23 00:43:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:14.941189 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61514353-611d-4429-9855-a48a0227df46 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:15.081927 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61514353-611d-4429-9855-a48a0227df46 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:15.083969 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:15.135753 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86037115-eabf-4303-8dc1-28ce55a5ddea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:15.136383 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86037115-eabf-4303-8dc1-28ce55a5ddea None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:15.136663 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86037115-eabf-4303-8dc1-28ce55a5ddea None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:15.136932 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86037115-eabf-4303-8dc1-28ce55a5ddea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:15.147180 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e89ed8-81bc-4240-b909-84d9de659b6c None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:15.149501 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86037115-eabf-4303-8dc1-28ce55a5ddea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:15.151175 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86037115-eabf-4303-8dc1-28ce55a5ddea None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:15.177463 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-86037115-eabf-4303-8dc1-28ce55a5ddea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:15.177463 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:15.177463 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:15.177463 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:15.177463 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:15.177463 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:15.177463 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:15.177463 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:15.177463 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:15.177463 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:15.177463 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:15.177463 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:15.177463 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:43:15.177463 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:43:15.177463 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:43:15.177463 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:43:15.178609 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:15.178609 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:15.178609 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:15.178609 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:15.178609 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:15.178609 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:15.178609 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:15.178609 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:15.178609 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:15.178609 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:15.178609 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:15.178609 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:15.178609 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:15.178609 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:15.178609 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:15.178609 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:15.178609 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:43:15.179456 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:43:15.179456 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:15.179456 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:15.187069 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 244/499] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:43:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:15.193733 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86037115-eabf-4303-8dc1-28ce55a5ddea None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:15.365829 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e89ed8-81bc-4240-b909-84d9de659b6c None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:15.418717 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86037115-eabf-4303-8dc1-28ce55a5ddea None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:15.428409 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5d4bb-3815-449c-b498-cd62a3dfee88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:15.429375 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5d4bb-3815-449c-b498-cd62a3dfee88 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:15.429886 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5d4bb-3815-449c-b498-cd62a3dfee88 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:15.430381 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5d4bb-3815-449c-b498-cd62a3dfee88 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:15.453066 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d5d4bb-3815-449c-b498-cd62a3dfee88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:43:15.466196 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-a6d5d4bb-3815-449c-b498-cd62a3dfee88 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:43:15.466196 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:15.466196 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:15.466196 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:15.466196 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:15.466196 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:15.466196 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:15.466196 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:15.466196 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:15.466196 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:15.466196 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:15.466196 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:15.466196 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:43:15.466196 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:43:15.466196 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:43:15.466196 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:43:15.467126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:43:15.467126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:43:15.467126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:43:15.467126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:43:15.467126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:15.467126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:15.467126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:15.467126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:15.467126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:15.467126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:15.467126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:15.467126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:15.467126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:15.467126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:15.467126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:15.467126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:15.467911 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:15.467911 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:15.467911 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:15.467911 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:15.467911 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:43:15.467911 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:43:15.467911 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:43:15.467911 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:43:15.467911 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:43:15.467911 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:43:15.467911 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:43:15.467911 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:15.471169 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 256/500] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 23 00:43:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:43:15.485650 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5d4bb-3815-449c-b498-cd62a3dfee88 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:15.488458 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2133dc5-e5bf-444a-8477-03423c215358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:15.489849 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2133dc5-e5bf-444a-8477-03423c215358 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:15.490348 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2133dc5-e5bf-444a-8477-03423c215358 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:15.490837 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2133dc5-e5bf-444a-8477-03423c215358 None admin] PATH_INFO: `/v3/domains` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:15.491669 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2133dc5-e5bf-444a-8477-03423c215358 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:15.492168 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2133dc5-e5bf-444a-8477-03423c215358 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:15.494004 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2133dc5-e5bf-444a-8477-03423c215358 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:15.508831 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 245/501] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:15.514716 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2133dc5-e5bf-444a-8477-03423c215358 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:15.543003 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:15.595955 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:15.672984 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5d4bb-3815-449c-b498-cd62a3dfee88 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:15.713788 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e61b9c-4934-4e6e-8e66-3e19fdbfb9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:15.714455 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e61b9c-4934-4e6e-8e66-3e19fdbfb9e5 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:15.714740 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e61b9c-4934-4e6e-8e66-3e19fdbfb9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:15.715016 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e61b9c-4934-4e6e-8e66-3e19fdbfb9e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:15.715713 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e61b9c-4934-4e6e-8e66-3e19fdbfb9e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:15.716023 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e61b9c-4934-4e6e-8e66-3e19fdbfb9e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:15.717463 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e61b9c-4934-4e6e-8e66-3e19fdbfb9e5 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:15.723441 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2133dc5-e5bf-444a-8477-03423c215358 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:15.738207 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 257/502] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 23 00:43:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:43:15.740562 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e61b9c-4934-4e6e-8e66-3e19fdbfb9e5 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:15.796830 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f59b74-985e-4609-8df4-47bc1a16a110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:15.797462 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f59b74-985e-4609-8df4-47bc1a16a110 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:15.797743 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f59b74-985e-4609-8df4-47bc1a16a110 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:15.798017 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f59b74-985e-4609-8df4-47bc1a16a110 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:15.813130 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f59b74-985e-4609-8df4-47bc1a16a110 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:15.814621 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f59b74-985e-4609-8df4-47bc1a16a110 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:15.834232 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-79f59b74-985e-4609-8df4-47bc1a16a110 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 23 00:43:15.834232 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:15.834232 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:15.834232 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:15.834232 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:15.834232 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:15.834232 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:15.834232 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:15.834232 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:15.834232 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:15.834232 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:15.834232 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:15.834232 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 00:43:15.834232 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 00:43:15.834232 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 00:43:15.834232 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 00:43:15.835689 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:15.835689 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:15.835689 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:43:15.835689 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:43:15.835689 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:43:15.835689 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:43:15.835689 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:15.835689 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:15.835689 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:15.835689 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:15.835689 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:15.835689 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:15.835689 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:15.835689 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:15.835689 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:15.835689 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:15.835689 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:15.835689 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:15.836615 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:15.836615 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:15.836615 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 00:43:15.836615 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 00:43:15.836615 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 00:43:15.836615 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 00:43:15.836615 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 00:43:15.836615 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 00:43:15.836615 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 23 00:43:15.836615 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:15.836615 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 246/503] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 23 00:43:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:15.844534 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f59b74-985e-4609-8df4-47bc1a16a110 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:15.902094 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e61b9c-4934-4e6e-8e66-3e19fdbfb9e5 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:15.917396 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:15.934069 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:15.949464 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74aece1-46ef-43ff-b63b-5aad7bd06867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:15.950601 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74aece1-46ef-43ff-b63b-5aad7bd06867 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:15.951038 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74aece1-46ef-43ff-b63b-5aad7bd06867 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:15.951726 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74aece1-46ef-43ff-b63b-5aad7bd06867 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:15.964001 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f59b74-985e-4609-8df4-47bc1a16a110 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:15.967590 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74aece1-46ef-43ff-b63b-5aad7bd06867 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:15.968568 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74aece1-46ef-43ff-b63b-5aad7bd06867 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:15.984109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-c74aece1-46ef-43ff-b63b-5aad7bd06867 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:15.984109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:15.984109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:15.984109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:15.984109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:15.984109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:15.984109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:15.984109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:15.984109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:15.984109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:15.984109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:15.984109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:15.984109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:43:15.984109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:43:15.984109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:43:15.984109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:43:15.985071 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:15.985071 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:15.985071 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:15.985071 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:15.985071 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:15.985071 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:15.985071 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:15.985071 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:15.985071 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:15.985071 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:15.985071 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:15.985071 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:15.985071 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:15.985071 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:15.985071 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:15.985071 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:15.985071 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:43:15.985996 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:43:15.985996 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:15.985996 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:15.990429 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 258/504] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:43:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:15.991684 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771fd4ea-935e-4eb7-8857-c7829fd967ac None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:15.991973 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771fd4ea-935e-4eb7-8857-c7829fd967ac None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:15.992254 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771fd4ea-935e-4eb7-8857-c7829fd967ac None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:15.993901 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 259/505] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:43:15.995687 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771fd4ea-935e-4eb7-8857-c7829fd967ac None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:16.007547 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb1330-b1c3-400b-8705-9c6b6bc8ff16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:16.008558 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb1330-b1c3-400b-8705-9c6b6bc8ff16 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:16.008985 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb1330-b1c3-400b-8705-9c6b6bc8ff16 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:16.009427 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb1330-b1c3-400b-8705-9c6b6bc8ff16 None admin] PATH_INFO: `/v3/users` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:16.010827 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb1330-b1c3-400b-8705-9c6b6bc8ff16 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:16.011277 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb1330-b1c3-400b-8705-9c6b6bc8ff16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:16.012960 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb1330-b1c3-400b-8705-9c6b6bc8ff16 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:16.032701 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 247/506] 10.222.0.23 () {56 vars in 1135 bytes} [Sun Oct 23 00:43:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:16.038797 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b677dc-6ac8-4ded-a3d9-6049f21d0c98 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:16.039247 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b677dc-6ac8-4ded-a3d9-6049f21d0c98 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:16.039667 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b677dc-6ac8-4ded-a3d9-6049f21d0c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:16.060247 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-71b677dc-6ac8-4ded-a3d9-6049f21d0c98 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:16.061811 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-71b677dc-6ac8-4ded-a3d9-6049f21d0c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:16.115227 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771fd4ea-935e-4eb7-8857-c7829fd967ac None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:16.136547 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 248/507] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:43:16.138211 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b677dc-6ac8-4ded-a3d9-6049f21d0c98 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:16.173145 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9c2cb-08a6-40e9-b60a-2455cfb66e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:16.173827 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9c2cb-08a6-40e9-b60a-2455cfb66e3e None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:16.174131 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9c2cb-08a6-40e9-b60a-2455cfb66e3e None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:16.174409 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9c2cb-08a6-40e9-b60a-2455cfb66e3e None admin] PATH_INFO: `/v3/domains` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:16.175065 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9c2cb-08a6-40e9-b60a-2455cfb66e3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:16.175487 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9c2cb-08a6-40e9-b60a-2455cfb66e3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:16.177132 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9c2cb-08a6-40e9-b60a-2455cfb66e3e None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:16.202857 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 260/508] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:16.204172 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9c2cb-08a6-40e9-b60a-2455cfb66e3e None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:16.205196 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:16.259893 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b677dc-6ac8-4ded-a3d9-6049f21d0c98 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:16.261686 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:16.303224 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9c9cc-a27a-403d-9962-c7e41ded80d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:16.305418 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9c9cc-a27a-403d-9962-c7e41ded80d3 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:16.305943 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9c9cc-a27a-403d-9962-c7e41ded80d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:16.307247 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9c9cc-a27a-403d-9962-c7e41ded80d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:16.405439 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a9c9cc-a27a-403d-9962-c7e41ded80d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:16.407226 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a9c9cc-a27a-403d-9962-c7e41ded80d3 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:16.422194 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9c2cb-08a6-40e9-b60a-2455cfb66e3e None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:16.477191 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:16.518748 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 249/509] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 23 00:43:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 23 00:43:16.518934 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f16c4-7d00-42c4-9c0d-eba4566cd84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:16.519528 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f16c4-7d00-42c4-9c0d-eba4566cd84b None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:16.519818 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f16c4-7d00-42c4-9c0d-eba4566cd84b None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:16.524809 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f16c4-7d00-42c4-9c0d-eba4566cd84b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:16.525291 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9c9cc-a27a-403d-9962-c7e41ded80d3 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:16.532774 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f16c4-7d00-42c4-9c0d-eba4566cd84b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:16.534264 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f16c4-7d00-42c4-9c0d-eba4566cd84b None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:16.550563 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-720f16c4-7d00-42c4-9c0d-eba4566cd84b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 23 00:43:16.550563 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:16.550563 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:16.550563 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:16.550563 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:16.550563 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:16.550563 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:16.550563 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:16.550563 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:16.550563 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:16.550563 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:16.550563 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:16.550563 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 00:43:16.550563 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 00:43:16.550563 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 00:43:16.550563 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 00:43:16.551535 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:16.551535 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:16.551535 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:43:16.551535 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:43:16.551535 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:43:16.551535 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:43:16.551535 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:16.551535 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:16.551535 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:16.551535 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:16.551535 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:16.551535 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:16.551535 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:16.551535 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:16.551535 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:16.551535 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:16.551535 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:16.551535 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:16.552470 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:16.552470 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:16.552470 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 00:43:16.552470 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 00:43:16.552470 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 00:43:16.552470 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 00:43:16.552470 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 00:43:16.552470 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 00:43:16.552470 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 23 00:43:16.552470 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:16.556474 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 261/510] 10.222.0.23 () {56 vars in 1093 bytes} [Sun Oct 23 00:43:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:43:16.557968 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f16c4-7d00-42c4-9c0d-eba4566cd84b None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:16.640598 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9c9cc-a27a-403d-9962-c7e41ded80d3 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:16.672496 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:16.685993 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e6ae20-1a85-46a5-a617-be14d8d5603f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:16.687501 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6ae20-1a85-46a5-a617-be14d8d5603f None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:16.688039 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6ae20-1a85-46a5-a617-be14d8d5603f None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:16.688462 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6ae20-1a85-46a5-a617-be14d8d5603f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:16.689301 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e6ae20-1a85-46a5-a617-be14d8d5603f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:16.690904 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e6ae20-1a85-46a5-a617-be14d8d5603f None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:16.692273 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f16c4-7d00-42c4-9c0d-eba4566cd84b None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:16.705194 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-61e6ae20-1a85-46a5-a617-be14d8d5603f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 23 00:43:16.705194 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:16.705194 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:43:16.705194 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:43:16.705194 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:43:16.705194 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:43:16.705194 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:43:16.705194 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:43:16.705194 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 23 00:43:16.705194 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:16.705194 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:43:16.705194 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:16.705194 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:16.705194 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:16.705194 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:16.705194 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:16.705194 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:16.706324 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:16.706324 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:16.706324 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:16.706324 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:16.706324 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:16.706324 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:16.706324 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:43:16.706324 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:43:16.706324 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:43:16.706324 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:43:16.706324 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:16.706324 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:16.706324 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:16.706324 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:16.706324 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:16.706324 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:16.707170 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:16.707170 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:16.707170 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:16.707170 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:16.707170 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:16.707170 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:16.707170 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:16.707170 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:16.707170 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:16.707170 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:16.707170 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:43:16.707170 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:43:16.707170 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 23 00:43:16.707170 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:16.709565 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 250/511] 10.222.0.23 () {56 vars in 1129 bytes} [Sun Oct 23 00:43:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:16.709565 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e6ae20-1a85-46a5-a617-be14d8d5603f None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:16.731613 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c7b75-ef0e-4299-840b-93d19a9ba130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:16.732167 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c7b75-ef0e-4299-840b-93d19a9ba130 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:16.732442 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c7b75-ef0e-4299-840b-93d19a9ba130 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:16.732708 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c7b75-ef0e-4299-840b-93d19a9ba130 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:16.739680 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:16.746111 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c7b75-ef0e-4299-840b-93d19a9ba130 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:16.747566 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c7b75-ef0e-4299-840b-93d19a9ba130 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:16.762550 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-d76c7b75-ef0e-4299-840b-93d19a9ba130 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:16.762550 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:16.762550 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:16.762550 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:16.762550 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:16.762550 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:16.762550 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:16.762550 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:16.762550 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:16.762550 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:16.762550 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:16.762550 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:16.762550 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:43:16.762550 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:43:16.762550 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:43:16.762550 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:43:16.763486 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:16.763486 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:16.763486 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:16.763486 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:16.763486 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:16.763486 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:16.763486 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:16.763486 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:16.763486 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:16.763486 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:16.763486 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:16.763486 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:16.763486 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:16.763486 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:16.763486 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:16.763486 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:16.763486 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:43:16.764374 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:43:16.764374 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:16.764374 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:16.764374 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 262/512] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:43:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:16.765114 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4ad26-9302-481f-b0af-7276b68f9b64 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:16.765114 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4ad26-9302-481f-b0af-7276b68f9b64 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:16.765470 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4ad26-9302-481f-b0af-7276b68f9b64 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:16.766679 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 263/513] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:43:16.767219 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4ad26-9302-481f-b0af-7276b68f9b64 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:16.823468 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e6ae20-1a85-46a5-a617-be14d8d5603f None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:16.856988 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a8e16-aead-44f7-8328-52f590fd1720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:16.857589 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a8e16-aead-44f7-8328-52f590fd1720 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:16.857872 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a8e16-aead-44f7-8328-52f590fd1720 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:16.858180 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a8e16-aead-44f7-8328-52f590fd1720 None admin] PATH_INFO: `/v3/users` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:16.858905 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a8e16-aead-44f7-8328-52f590fd1720 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:16.859215 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a8e16-aead-44f7-8328-52f590fd1720 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:16.860670 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a8e16-aead-44f7-8328-52f590fd1720 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:16.868835 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4ad26-9302-481f-b0af-7276b68f9b64 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:16.877664 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 251/514] 10.222.0.23 () {56 vars in 1133 bytes} [Sun Oct 23 00:43:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:16.878491 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a8e16-aead-44f7-8328-52f590fd1720 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:16.902761 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baacac3-612c-4f5b-804d-589987c9b180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:16.903373 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baacac3-612c-4f5b-804d-589987c9b180 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:16.903657 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baacac3-612c-4f5b-804d-589987c9b180 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:16.904238 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baacac3-612c-4f5b-804d-589987c9b180 None admin] PATH_INFO: `/v3/services` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:16.904560 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baacac3-612c-4f5b-804d-589987c9b180 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:16.904865 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baacac3-612c-4f5b-804d-589987c9b180 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:16.906269 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baacac3-612c-4f5b-804d-589987c9b180 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:16.908080 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:16.912517 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 264/515] 10.222.0.23 () {56 vars in 1124 bytes} [Sun Oct 23 00:43:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:16.913702 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf78f65-5084-4fad-864f-c88c9fae1673 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:16.913987 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf78f65-5084-4fad-864f-c88c9fae1673 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:16.914320 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf78f65-5084-4fad-864f-c88c9fae1673 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:16.915538 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 265/516] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:43:16.916543 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a04dd-36b1-42de-b37e-463b63f89cbd None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:16.916921 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a04dd-36b1-42de-b37e-463b63f89cbd None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:16.917104 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a04dd-36b1-42de-b37e-463b63f89cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:16.934655 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-987a04dd-36b1-42de-b37e-463b63f89cbd None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:16.935851 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-987a04dd-36b1-42de-b37e-463b63f89cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:16.967101 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:16.983416 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a8e16-aead-44f7-8328-52f590fd1720 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:17.001820 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 266/517] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:43:17.002827 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a04dd-36b1-42de-b37e-463b63f89cbd None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:17.030174 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648384c8-2f10-4123-badd-8b31305dd161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:17.031284 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648384c8-2f10-4123-badd-8b31305dd161 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:17.031567 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648384c8-2f10-4123-badd-8b31305dd161 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:17.032115 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648384c8-2f10-4123-badd-8b31305dd161 None admin] PATH_INFO: `/v3/domains` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:17.032752 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648384c8-2f10-4123-badd-8b31305dd161 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:17.033300 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648384c8-2f10-4123-badd-8b31305dd161 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:17.035382 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648384c8-2f10-4123-badd-8b31305dd161 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:17.048534 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 252/518] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:43:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:17.049331 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648384c8-2f10-4123-badd-8b31305dd161 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:17.115054 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a04dd-36b1-42de-b37e-463b63f89cbd None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:17.144022 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:17.151086 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95662016-068d-4709-b5bb-5c4165f7749d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:17.151837 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95662016-068d-4709-b5bb-5c4165f7749d None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:17.152219 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95662016-068d-4709-b5bb-5c4165f7749d None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:17.152613 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95662016-068d-4709-b5bb-5c4165f7749d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:17.159940 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648384c8-2f10-4123-badd-8b31305dd161 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:17.165190 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95662016-068d-4709-b5bb-5c4165f7749d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:17.166711 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95662016-068d-4709-b5bb-5c4165f7749d None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:17.181852 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-95662016-068d-4709-b5bb-5c4165f7749d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:17.181852 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:17.181852 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:17.181852 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:17.181852 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:17.181852 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:17.181852 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:17.181852 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:17.181852 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:17.181852 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:17.181852 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:17.181852 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:17.181852 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:43:17.181852 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:43:17.181852 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:43:17.181852 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:43:17.183397 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:17.183397 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:17.183397 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:17.183397 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:17.183397 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:17.183397 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:17.183397 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:17.183397 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:17.183397 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:17.183397 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:17.183397 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:17.183397 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:17.183397 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:17.183397 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:17.183397 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:17.183397 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:17.183397 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:43:17.184435 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:43:17.184435 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:17.184435 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:17.187615 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 267/519] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:43:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:17.188835 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9a772-f794-4a6d-bd42-0c246f7d79ac None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:17.189123 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9a772-f794-4a6d-bd42-0c246f7d79ac None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:17.189399 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9a772-f794-4a6d-bd42-0c246f7d79ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:17.200226 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264b402-c1ae-4744-a03f-8cd4d150e07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:17.201058 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264b402-c1ae-4744-a03f-8cd4d150e07c None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:17.201481 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264b402-c1ae-4744-a03f-8cd4d150e07c None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:17.201919 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264b402-c1ae-4744-a03f-8cd4d150e07c None admin] PATH_INFO: `/v3/services` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:17.202834 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2264b402-c1ae-4744-a03f-8cd4d150e07c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:17.203138 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2264b402-c1ae-4744-a03f-8cd4d150e07c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:17.204495 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2264b402-c1ae-4744-a03f-8cd4d150e07c None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:17.208099 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-fee9a772-f794-4a6d-bd42-0c246f7d79ac None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:17.209294 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-fee9a772-f794-4a6d-bd42-0c246f7d79ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:17.218280 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 253/520] 10.222.0.23 () {56 vars in 1124 bytes} [Sun Oct 23 00:43:17 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:17.218280 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264b402-c1ae-4744-a03f-8cd4d150e07c None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:17.235736 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:17.302002 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 268/521] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:43:17.302930 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9a772-f794-4a6d-bd42-0c246f7d79ac None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:17.350389 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264b402-c1ae-4744-a03f-8cd4d150e07c None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:17.396183 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3aabbc-ddc5-46bd-9c93-63bd16535bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:17.396913 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3aabbc-ddc5-46bd-9c93-63bd16535bfd None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:17.397184 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3aabbc-ddc5-46bd-9c93-63bd16535bfd None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:17.397456 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3aabbc-ddc5-46bd-9c93-63bd16535bfd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:17.405749 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3aabbc-ddc5-46bd-9c93-63bd16535bfd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:17.407315 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3aabbc-ddc5-46bd-9c93-63bd16535bfd None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:17.423939 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-fb3aabbc-ddc5-46bd-9c93-63bd16535bfd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:43:17.423939 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:17.423939 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:17.423939 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:17.423939 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:17.423939 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:17.423939 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:17.423939 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:17.423939 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:17.423939 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:17.423939 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:17.423939 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:17.423939 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 00:43:17.423939 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 00:43:17.423939 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 00:43:17.425053 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 00:43:17.425053 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:17.425053 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:17.425053 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:17.425053 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:17.425053 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:17.425053 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:17.425053 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:17.425053 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:17.425053 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:17.425053 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:17.425053 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:17.425053 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:17.425053 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:17.425053 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:17.425053 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:17.425053 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:17.426112 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 00:43:17.426112 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 00:43:17.426112 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 00:43:17.426112 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 00:43:17.426112 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 00:43:17.426112 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 00:43:17.426112 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:43:17.426112 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:17.426112 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 254/522] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 23 00:43:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:17.431258 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3aabbc-ddc5-46bd-9c93-63bd16535bfd None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:17.445459 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9a772-f794-4a6d-bd42-0c246f7d79ac None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:17.461669 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:17.487247 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4156d32f-778e-43b4-bb82-49c64a88a18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:17.488082 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156d32f-778e-43b4-bb82-49c64a88a18a None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:17.488514 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156d32f-778e-43b4-bb82-49c64a88a18a None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:17.488995 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156d32f-778e-43b4-bb82-49c64a88a18a None admin] PATH_INFO: `/v3/domains` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:17.490332 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4156d32f-778e-43b4-bb82-49c64a88a18a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:17.490837 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4156d32f-778e-43b4-bb82-49c64a88a18a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:17.492420 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4156d32f-778e-43b4-bb82-49c64a88a18a None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:17.504602 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 269/523] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:17.505761 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4156d32f-778e-43b4-bb82-49c64a88a18a None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:17.513252 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:17.553088 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3aabbc-ddc5-46bd-9c93-63bd16535bfd None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:17.590988 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9c8e0-dbbb-489d-90af-59ec342bc960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:17.591615 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9c8e0-dbbb-489d-90af-59ec342bc960 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:17.591893 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9c8e0-dbbb-489d-90af-59ec342bc960 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:17.592167 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9c8e0-dbbb-489d-90af-59ec342bc960 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:17.602793 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f9c8e0-dbbb-489d-90af-59ec342bc960 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:43:17.608280 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-45f9c8e0-dbbb-489d-90af-59ec342bc960 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:43:17.608280 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:17.608280 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:17.608280 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:17.608280 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:17.608280 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:17.608280 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:17.608280 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:17.608280 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:17.608280 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:17.608280 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:17.608280 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:17.608280 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:43:17.608280 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:43:17.608280 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:43:17.608280 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:43:17.609359 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:43:17.609359 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:43:17.609359 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:43:17.609359 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:43:17.609359 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:17.609359 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:17.609359 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:17.609359 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:17.609359 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:17.609359 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:17.609359 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:17.609359 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:17.609359 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:17.609359 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:17.609359 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:17.609359 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:17.610393 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:17.610393 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:17.610393 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:17.610393 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:17.610393 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:43:17.610393 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:43:17.610393 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:43:17.610393 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:43:17.610393 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:43:17.610393 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:43:17.610393 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:43:17.610393 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:17.610393 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 255/524] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 23 00:43:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:17.611110 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9c8e0-dbbb-489d-90af-59ec342bc960 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:17.620156 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4156d32f-778e-43b4-bb82-49c64a88a18a None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:17.656567 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c6d4c-d6d2-4ac9-86ad-9e071035d552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:17.657243 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c6d4c-d6d2-4ac9-86ad-9e071035d552 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:17.657435 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c6d4c-d6d2-4ac9-86ad-9e071035d552 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:17.657699 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c6d4c-d6d2-4ac9-86ad-9e071035d552 None admin] PATH_INFO: `/v3/projects` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:17.658419 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c6d4c-d6d2-4ac9-86ad-9e071035d552 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:17.658718 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c6d4c-d6d2-4ac9-86ad-9e071035d552 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:17.660160 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c6d4c-d6d2-4ac9-86ad-9e071035d552 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:17.680180 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 270/525] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 23 00:43:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:17.680180 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c6d4c-d6d2-4ac9-86ad-9e071035d552 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:17.715655 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:17.719025 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9c8e0-dbbb-489d-90af-59ec342bc960 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:17.746638 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:17.755710 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c15dfa-a0b0-492a-8b17-8045b40b1555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:17.756340 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c15dfa-a0b0-492a-8b17-8045b40b1555 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:17.756621 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c15dfa-a0b0-492a-8b17-8045b40b1555 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:17.756895 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c15dfa-a0b0-492a-8b17-8045b40b1555 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:17.764941 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c15dfa-a0b0-492a-8b17-8045b40b1555 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:17.766865 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c15dfa-a0b0-492a-8b17-8045b40b1555 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:17.779593 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-e7c15dfa-a0b0-492a-8b17-8045b40b1555 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:43:17.779593 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:17.779593 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:17.779593 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:17.779593 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:17.779593 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:17.779593 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:17.779593 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:17.779593 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:17.779593 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:17.779593 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:17.779593 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:17.779593 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 00:43:17.779593 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 00:43:17.779593 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 00:43:17.780497 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 00:43:17.780497 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:17.780497 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:17.780497 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:17.780497 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:17.780497 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:17.780497 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:17.780497 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:17.780497 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:17.780497 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:17.780497 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:17.780497 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:17.780497 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:17.780497 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:17.780497 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:17.780497 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:17.780497 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:17.781393 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 00:43:17.781393 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 00:43:17.781393 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 00:43:17.781393 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 00:43:17.781393 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 00:43:17.781393 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 00:43:17.781393 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:43:17.781393 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:17.781393 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 256/526] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 23 00:43:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:17.781393 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c15dfa-a0b0-492a-8b17-8045b40b1555 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:17.798719 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c6d4c-d6d2-4ac9-86ad-9e071035d552 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:17.835376 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27ad39-b03f-4803-930d-d0c4dfab89bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:17.836006 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27ad39-b03f-4803-930d-d0c4dfab89bf None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:17.836295 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27ad39-b03f-4803-930d-d0c4dfab89bf None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:17.836580 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27ad39-b03f-4803-930d-d0c4dfab89bf None admin] PATH_INFO: `/v3/services/network` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:17.837153 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a27ad39-b03f-4803-930d-d0c4dfab89bf None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:17.838560 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a27ad39-b03f-4803-930d-d0c4dfab89bf None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:17.852642 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-6a27ad39-b03f-4803-930d-d0c4dfab89bf None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 23 00:43:17.852642 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:17.852642 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:43:17.852642 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:43:17.852642 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:43:17.852642 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:43:17.852642 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:43:17.852642 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:43:17.852642 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 23 00:43:17.852642 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:17.852642 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:43:17.852642 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:17.852642 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:17.852642 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:17.852642 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:17.852642 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:17.852642 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:17.853598 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:17.853598 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:17.853598 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:17.853598 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:17.853598 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:17.853598 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:17.853598 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:43:17.853598 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:43:17.853598 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:43:17.853598 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:43:17.853598 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:17.853598 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:17.853598 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:17.853598 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:17.853598 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:17.853598 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:17.859196 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:17.859196 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:17.859196 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:17.859196 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:17.859196 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:17.859196 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:17.859196 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:17.859196 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:17.859196 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:17.859196 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:17.859196 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:43:17.859196 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:43:17.859196 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 23 00:43:17.859196 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:17.859196 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 271/527] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 23 00:43:17 2022] GET /identity/v3/services/network => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:17.859986 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27ad39-b03f-4803-930d-d0c4dfab89bf None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:17.889871 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c15dfa-a0b0-492a-8b17-8045b40b1555 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:17.927863 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a6303-5fa0-4d06-8b20-b04daa00e402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:17.928461 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a6303-5fa0-4d06-8b20-b04daa00e402 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:17.928738 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a6303-5fa0-4d06-8b20-b04daa00e402 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:17.929066 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a6303-5fa0-4d06-8b20-b04daa00e402 None admin] PATH_INFO: `/v3/roles` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:17.929751 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069a6303-5fa0-4d06-8b20-b04daa00e402 None admin] RBAC: Adding query filter params (name=service) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:17.930050 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069a6303-5fa0-4d06-8b20-b04daa00e402 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:17.931446 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069a6303-5fa0-4d06-8b20-b04daa00e402 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:17.944357 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 257/528] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Oct 23 00:43:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:17.944357 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a6303-5fa0-4d06-8b20-b04daa00e402 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:17.963081 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:17.969182 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27ad39-b03f-4803-930d-d0c4dfab89bf None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:17.996350 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:18.006647 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3506958-bb8f-4ee2-8a25-313fbff15ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:18.007295 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3506958-bb8f-4ee2-8a25-313fbff15ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:18.007589 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3506958-bb8f-4ee2-8a25-313fbff15ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:18.007874 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3506958-bb8f-4ee2-8a25-313fbff15ad3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:18.008594 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3506958-bb8f-4ee2-8a25-313fbff15ad3 None admin] RBAC: Adding query filter params (role.id=832e4b25a75c4d30a010d6803a5a4577, scope.project.id=60f8594760e44ce3888a32702ea9afcc, user.id=84a0345be05644e3a7a71c5a2bf21c41) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:18.008907 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3506958-bb8f-4ee2-8a25-313fbff15ad3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:18.010382 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3506958-bb8f-4ee2-8a25-313fbff15ad3 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:18.016361 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 272/529] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 23 00:43:17 2022] GET /identity/v3/role_assignments?user.id=84a0345be05644e3a7a71c5a2bf21c41&scope.project.id=60f8594760e44ce3888a32702ea9afcc&role.id=832e4b25a75c4d30a010d6803a5a4577 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:18.023196 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3506958-bb8f-4ee2-8a25-313fbff15ad3 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:18.062819 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a6303-5fa0-4d06-8b20-b04daa00e402 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:18.114478 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702f4a1-11aa-44bd-b40e-e553e538ff46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:18.115432 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702f4a1-11aa-44bd-b40e-e553e538ff46 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:18.115890 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702f4a1-11aa-44bd-b40e-e553e538ff46 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:18.116362 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702f4a1-11aa-44bd-b40e-e553e538ff46 None admin] PATH_INFO: `/v3/projects` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:18.117422 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d702f4a1-11aa-44bd-b40e-e553e538ff46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:18.118521 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d702f4a1-11aa-44bd-b40e-e553e538ff46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:18.120857 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d702f4a1-11aa-44bd-b40e-e553e538ff46 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:18.138463 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 258/530] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 23 00:43:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:18.139934 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702f4a1-11aa-44bd-b40e-e553e538ff46 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:18.168968 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3506958-bb8f-4ee2-8a25-313fbff15ad3 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:18.214041 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcfb628-8061-44d4-ba7f-beb50a2024c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:18.214725 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfb628-8061-44d4-ba7f-beb50a2024c6 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:18.214963 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfb628-8061-44d4-ba7f-beb50a2024c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:18.215241 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfb628-8061-44d4-ba7f-beb50a2024c6 None admin] PATH_INFO: `/v3/services` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:18.215882 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcfb628-8061-44d4-ba7f-beb50a2024c6 None admin] RBAC: Adding query filter params (name=network) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:18.216875 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcfb628-8061-44d4-ba7f-beb50a2024c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:18.217878 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcfb628-8061-44d4-ba7f-beb50a2024c6 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:18.225360 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 273/531] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Oct 23 00:43:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:18.225360 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcfb628-8061-44d4-ba7f-beb50a2024c6 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:18.256816 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:18.300584 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702f4a1-11aa-44bd-b40e-e553e538ff46 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:18.315817 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:18.345013 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcfb628-8061-44d4-ba7f-beb50a2024c6 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:18.349054 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e32b35-2349-4fad-aca2-8fcb2194f8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:18.349054 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e32b35-2349-4fad-aca2-8fcb2194f8dd None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:18.349296 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e32b35-2349-4fad-aca2-8fcb2194f8dd None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:18.349537 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e32b35-2349-4fad-aca2-8fcb2194f8dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:18.360729 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e32b35-2349-4fad-aca2-8fcb2194f8dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:18.362200 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e32b35-2349-4fad-aca2-8fcb2194f8dd None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:18.378019 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-81e32b35-2349-4fad-aca2-8fcb2194f8dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:18.378019 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:18.378019 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:18.378019 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:18.378019 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:18.378019 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:18.378019 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:18.378019 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:18.378019 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:18.378019 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:18.378019 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:18.378019 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:18.378019 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:43:18.378019 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:43:18.378019 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:43:18.378019 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:43:18.379015 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:18.379015 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:18.379015 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:18.379015 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:18.379015 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:18.379015 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:18.379015 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:18.379015 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:18.379015 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:18.379015 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:18.379015 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:18.379015 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:18.379015 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:18.379015 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:18.379015 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:18.379015 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:18.379015 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:43:18.379934 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:43:18.379934 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:18.379934 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:18.379934 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 259/532] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:43:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:18.380589 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e32b35-2349-4fad-aca2-8fcb2194f8dd None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:18.391768 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14760e-e542-4ee8-8c7c-7e02eea1b23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:18.393233 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14760e-e542-4ee8-8c7c-7e02eea1b23d None admin] REQUEST_METHOD: `PUT` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:18.394231 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14760e-e542-4ee8-8c7c-7e02eea1b23d None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:18.394727 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14760e-e542-4ee8-8c7c-7e02eea1b23d None admin] PATH_INFO: `/v3/projects/60f8594760e44ce3888a32702ea9afcc/users/90f691140a8341ada73a8c6f01ad798c/roles/1e2073be75174689aa4fac29e674583d` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:18.397914 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14760e-e542-4ee8-8c7c-7e02eea1b23d None admin] RBAC: Authorizing `identity:create_grant(project_id=60f8594760e44ce3888a32702ea9afcc, user_id=90f691140a8341ada73a8c6f01ad798c, role_id=1e2073be75174689aa4fac29e674583d)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:18.400235 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14760e-e542-4ee8-8c7c-7e02eea1b23d None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:18.426111 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 274/533] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 23 00:43:18 2022] PUT /identity/v3/projects/60f8594760e44ce3888a32702ea9afcc/users/90f691140a8341ada73a8c6f01ad798c/roles/1e2073be75174689aa4fac29e674583d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:43:18.426111 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14760e-e542-4ee8-8c7c-7e02eea1b23d None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:18.540908 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e32b35-2349-4fad-aca2-8fcb2194f8dd None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:18.602519 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:18.616400 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14760e-e542-4ee8-8c7c-7e02eea1b23d None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:18.622870 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2dc668-1801-447b-807d-a2075c076221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:18.623555 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dc668-1801-447b-807d-a2075c076221 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:18.623838 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dc668-1801-447b-807d-a2075c076221 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:18.624116 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dc668-1801-447b-807d-a2075c076221 None admin] PATH_INFO: `/v3/services` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:18.624760 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2dc668-1801-447b-807d-a2075c076221 None admin] RBAC: Adding query filter params (type=network) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:18.625063 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2dc668-1801-447b-807d-a2075c076221 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:18.626498 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2dc668-1801-447b-807d-a2075c076221 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:18.639018 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 260/534] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Oct 23 00:43:18 2022] GET /identity/v3/services?type=network => generated 124 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:18.664971 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f297b-ee55-4971-b56a-9aef0a6cf9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:18.665658 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f297b-ee55-4971-b56a-9aef0a6cf9f3 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:18.665952 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f297b-ee55-4971-b56a-9aef0a6cf9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:18.666262 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f297b-ee55-4971-b56a-9aef0a6cf9f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:18.666934 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f297b-ee55-4971-b56a-9aef0a6cf9f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:18.667244 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f297b-ee55-4971-b56a-9aef0a6cf9f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:18.668730 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f297b-ee55-4971-b56a-9aef0a6cf9f3 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:18.688650 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 275/535] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:43:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:18.694016 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2dc668-1801-447b-807d-a2075c076221 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:18.726554 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:18.819364 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2dc668-1801-447b-807d-a2075c076221 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:18.865309 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42014a65-87dd-4d33-8e38-afa867e331b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:18.865943 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42014a65-87dd-4d33-8e38-afa867e331b1 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:18.866264 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42014a65-87dd-4d33-8e38-afa867e331b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:18.866550 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42014a65-87dd-4d33-8e38-afa867e331b1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:18.874444 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42014a65-87dd-4d33-8e38-afa867e331b1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:18.875897 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42014a65-87dd-4d33-8e38-afa867e331b1 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:18.888958 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-42014a65-87dd-4d33-8e38-afa867e331b1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 23 00:43:18.888958 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:18.888958 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:18.888958 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:18.888958 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:18.888958 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:18.888958 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:18.888958 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:18.888958 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:18.888958 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:18.888958 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:18.888958 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:18.888958 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 00:43:18.888958 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 00:43:18.888958 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 00:43:18.888958 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 00:43:18.889903 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:18.889903 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:18.889903 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:43:18.889903 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:43:18.889903 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:43:18.889903 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:43:18.889903 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:18.889903 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:18.889903 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:18.889903 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:18.889903 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:18.889903 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:18.889903 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:18.889903 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:18.889903 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:18.889903 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:18.889903 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:18.889903 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:18.890946 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:18.890946 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:18.890946 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 00:43:18.890946 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 00:43:18.890946 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 00:43:18.890946 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 00:43:18.890946 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 00:43:18.890946 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 00:43:18.890946 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 23 00:43:18.890946 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:18.894470 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 261/536] 10.222.0.23 () {56 vars in 1117 bytes} [Sun Oct 23 00:43:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:18.896647 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f297b-ee55-4971-b56a-9aef0a6cf9f3 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:19.006401 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f297b-ee55-4971-b56a-9aef0a6cf9f3 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:19.043765 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4911196e-c1a5-49f2-93a5-6afc9c6054fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:19.044374 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911196e-c1a5-49f2-93a5-6afc9c6054fb None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:19.044661 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911196e-c1a5-49f2-93a5-6afc9c6054fb None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:19.044938 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911196e-c1a5-49f2-93a5-6afc9c6054fb None admin] PATH_INFO: `/v3/users` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:19.045668 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4911196e-c1a5-49f2-93a5-6afc9c6054fb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:19.045975 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4911196e-c1a5-49f2-93a5-6afc9c6054fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:19.047444 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4911196e-c1a5-49f2-93a5-6afc9c6054fb None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:19.071249 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 276/537] 10.222.0.23 () {56 vars in 1149 bytes} [Sun Oct 23 00:43:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:19.076803 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42014a65-87dd-4d33-8e38-afa867e331b1 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:19.202373 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:19.224696 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42014a65-87dd-4d33-8e38-afa867e331b1 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:19.278363 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2730f-46e3-4434-a561-5e8aa281afb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:19.278996 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2730f-46e3-4434-a561-5e8aa281afb3 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:19.279271 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2730f-46e3-4434-a561-5e8aa281afb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:19.279541 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2730f-46e3-4434-a561-5e8aa281afb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:19.293628 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2730f-46e3-4434-a561-5e8aa281afb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:19.295435 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2730f-46e3-4434-a561-5e8aa281afb3 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:19.310857 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-4eb2730f-46e3-4434-a561-5e8aa281afb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:19.310857 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:19.310857 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:19.310857 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:19.310857 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:19.310857 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:19.310857 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:19.310857 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:19.310857 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:19.310857 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:19.310857 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:19.310857 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:19.310857 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:43:19.310857 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:43:19.310857 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:43:19.310857 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:43:19.312226 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:19.312226 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:19.312226 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:19.312226 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:19.312226 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:19.312226 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:19.312226 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:19.312226 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:19.312226 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:19.312226 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:19.312226 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:19.312226 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:19.312226 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:19.312226 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:19.312226 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:19.312226 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:19.312226 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:43:19.313089 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:43:19.313089 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:19.313089 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:19.315198 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 262/538] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:43:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:19.321196 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4911196e-c1a5-49f2-93a5-6afc9c6054fb None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:19.325947 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:19.459433 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4911196e-c1a5-49f2-93a5-6afc9c6054fb None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:19.508178 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaaacfd-1e38-4786-8802-fc7097990468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:19.508853 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaaacfd-1e38-4786-8802-fc7097990468 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:19.509139 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaaacfd-1e38-4786-8802-fc7097990468 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:19.509414 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaaacfd-1e38-4786-8802-fc7097990468 None admin] PATH_INFO: `/v3/domains` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:19.510065 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaaacfd-1e38-4786-8802-fc7097990468 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:19.510390 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaaacfd-1e38-4786-8802-fc7097990468 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:19.511771 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaaacfd-1e38-4786-8802-fc7097990468 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:19.528653 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 277/539] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:43:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:19.530318 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2730f-46e3-4434-a561-5e8aa281afb3 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:19.659552 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2730f-46e3-4434-a561-5e8aa281afb3 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:19.701621 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c96e4-98e2-4c88-8598-b6f93c34bed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:19.702277 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c96e4-98e2-4c88-8598-b6f93c34bed1 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:19.702564 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c96e4-98e2-4c88-8598-b6f93c34bed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:19.702839 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c96e4-98e2-4c88-8598-b6f93c34bed1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:19.710154 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2c96e4-98e2-4c88-8598-b6f93c34bed1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:19.711683 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2c96e4-98e2-4c88-8598-b6f93c34bed1 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:19.714373 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:19.727450 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-aa2c96e4-98e2-4c88-8598-b6f93c34bed1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:43:19.727450 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:19.727450 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:19.727450 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:19.727450 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:19.727450 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:19.727450 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:19.727450 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:19.727450 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:19.727450 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:19.727450 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:19.727450 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:19.727450 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 00:43:19.727450 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 00:43:19.727450 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 00:43:19.728335 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 00:43:19.728335 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:19.728335 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:19.728335 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:19.728335 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:19.728335 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:19.728335 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:19.728335 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:19.728335 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:19.728335 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:19.728335 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:19.728335 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:19.728335 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:19.728335 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:19.728335 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:19.728335 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:19.728335 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:19.729215 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 00:43:19.729215 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 00:43:19.729215 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 00:43:19.729215 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 00:43:19.729215 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 00:43:19.729215 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 00:43:19.729215 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:43:19.729215 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:19.733818 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 263/540] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 23 00:43:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:19.735299 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaaacfd-1e38-4786-8802-fc7097990468 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:19.771771 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdbf33-baf8-4b77-bd0c-807ad8ab8de6 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:19.772082 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdbf33-baf8-4b77-bd0c-807ad8ab8de6 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:19.772322 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdbf33-baf8-4b77-bd0c-807ad8ab8de6 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:19.773669 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 264/541] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:43:19.778715 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cd708-86f9-4a5c-a642-319398aee4c7 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:19.779006 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cd708-86f9-4a5c-a642-319398aee4c7 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:19.779273 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cd708-86f9-4a5c-a642-319398aee4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:19.805769 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-b24cd708-86f9-4a5c-a642-319398aee4c7 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:19.807835 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-b24cd708-86f9-4a5c-a642-319398aee4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:19.859295 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:19.924349 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaaacfd-1e38-4786-8802-fc7097990468 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:19.935854 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 265/542] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 00:43:19.961208 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729cd832-aa3f-4503-95ae-810479369796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:19.961817 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729cd832-aa3f-4503-95ae-810479369796 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:19.962197 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729cd832-aa3f-4503-95ae-810479369796 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:19.962522 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729cd832-aa3f-4503-95ae-810479369796 None admin] PATH_INFO: `/v3/projects` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:19.963218 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729cd832-aa3f-4503-95ae-810479369796 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:19.963525 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729cd832-aa3f-4503-95ae-810479369796 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:19.964979 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729cd832-aa3f-4503-95ae-810479369796 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:19.982233 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 278/543] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 23 00:43:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:19.984313 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24cd708-86f9-4a5c-a642-319398aee4c7 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:20.131509 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24cd708-86f9-4a5c-a642-319398aee4c7 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:20.168255 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:20.179642 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36a331-8837-4431-8b94-d2dd85cd2dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:20.180231 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36a331-8837-4431-8b94-d2dd85cd2dc6 None admin] REQUEST_METHOD: `PUT` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:20.180509 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36a331-8837-4431-8b94-d2dd85cd2dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:20.180782 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36a331-8837-4431-8b94-d2dd85cd2dc6 None admin] PATH_INFO: `/v3/projects/60f8594760e44ce3888a32702ea9afcc/users/f183fd83a96a4af0bc9df03e6f61ca4a/roles/832e4b25a75c4d30a010d6803a5a4577` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:20.196005 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36a331-8837-4431-8b94-d2dd85cd2dc6 None admin] RBAC: Authorizing `identity:create_grant(project_id=60f8594760e44ce3888a32702ea9afcc, user_id=f183fd83a96a4af0bc9df03e6f61ca4a, role_id=832e4b25a75c4d30a010d6803a5a4577)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:20.197453 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36a331-8837-4431-8b94-d2dd85cd2dc6 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:20.214174 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 266/544] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 23 00:43:19 2022] PUT /identity/v3/projects/60f8594760e44ce3888a32702ea9afcc/users/f183fd83a96a4af0bc9df03e6f61ca4a/roles/832e4b25a75c4d30a010d6803a5a4577 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:43:20.281388 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729cd832-aa3f-4503-95ae-810479369796 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:20.388343 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d860e-35a7-45a4-b5ae-8c5b9ecfa55f None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:20.389329 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d860e-35a7-45a4-b5ae-8c5b9ecfa55f None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:20.389834 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d860e-35a7-45a4-b5ae-8c5b9ecfa55f None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:20.391660 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 267/545] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:43:20.397437 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f5a8b-abc3-4cb6-8ce8-988bc76ab47f None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:20.397955 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f5a8b-abc3-4cb6-8ce8-988bc76ab47f None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:20.398450 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f5a8b-abc3-4cb6-8ce8-988bc76ab47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:20.417784 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-e25f5a8b-abc3-4cb6-8ce8-988bc76ab47f None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:20.419405 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-e25f5a8b-abc3-4cb6-8ce8-988bc76ab47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:20.422373 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729cd832-aa3f-4503-95ae-810479369796 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:20.460988 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:20.486896 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f2fe3-2c65-459f-b463-29a62aeab221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:20.487549 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f2fe3-2c65-459f-b463-29a62aeab221 None admin] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:20.487827 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f2fe3-2c65-459f-b463-29a62aeab221 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:20.488103 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f2fe3-2c65-459f-b463-29a62aeab221 None admin] PATH_INFO: `/v3/services` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:20.488918 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f2fe3-2c65-459f-b463-29a62aeab221 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:20.490806 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f2fe3-2c65-459f-b463-29a62aeab221 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:20.497165 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 268/546] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 00:43:20.524714 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 279/547] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Oct 23 00:43:20 2022] POST /identity/v3/services => generated 251 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:43:20.781645 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f5a8b-abc3-4cb6-8ce8-988bc76ab47f None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:20.887818 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f5a8b-abc3-4cb6-8ce8-988bc76ab47f None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:20.898412 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:20.943699 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb96555-6e77-4e77-a1f9-6ec07db8ab52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:20.944668 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb96555-6e77-4e77-a1f9-6ec07db8ab52 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:20.945125 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb96555-6e77-4e77-a1f9-6ec07db8ab52 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:20.945571 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb96555-6e77-4e77-a1f9-6ec07db8ab52 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:20.957317 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb96555-6e77-4e77-a1f9-6ec07db8ab52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:43:20.962878 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-dfb96555-6e77-4e77-a1f9-6ec07db8ab52 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:43:20.962878 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:20.962878 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:20.962878 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:20.962878 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:20.962878 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:20.962878 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:20.962878 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:20.962878 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:20.962878 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:20.962878 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:20.962878 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:20.962878 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:43:20.962878 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:43:20.962878 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:43:20.962878 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:43:20.963787 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:43:20.963787 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:43:20.963787 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:43:20.963787 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:43:20.963787 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:20.963787 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:20.963787 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:20.963787 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:20.963787 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:20.963787 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:20.963787 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:20.963787 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:20.963787 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:20.963787 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:20.963787 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:20.963787 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:20.964691 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:20.964691 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:20.964691 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:20.964691 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:20.964691 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:43:20.964691 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:43:20.964691 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:43:20.964691 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:43:20.964691 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:43:20.964691 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:43:20.964691 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:43:20.964691 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:20.967016 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 269/548] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 23 00:43:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:20.972915 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f2fe3-2c65-459f-b463-29a62aeab221 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:21.099587 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f2fe3-2c65-459f-b463-29a62aeab221 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:21.135522 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a9bd9-c088-4693-9353-400fff66d02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:21.136421 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a9bd9-c088-4693-9353-400fff66d02c None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:21.136847 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a9bd9-c088-4693-9353-400fff66d02c None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:21.137277 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a9bd9-c088-4693-9353-400fff66d02c None admin] PATH_INFO: `/v3/roles` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:21.138110 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343a9bd9-c088-4693-9353-400fff66d02c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:21.138548 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343a9bd9-c088-4693-9353-400fff66d02c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:21.140068 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343a9bd9-c088-4693-9353-400fff66d02c None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:21.149922 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 280/549] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 23 00:43:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:21.155569 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb96555-6e77-4e77-a1f9-6ec07db8ab52 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:21.276693 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb96555-6e77-4e77-a1f9-6ec07db8ab52 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:21.322303 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614abae5-734a-44aa-9cc8-67d29e9ad2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:21.322929 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614abae5-734a-44aa-9cc8-67d29e9ad2d1 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:21.323206 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614abae5-734a-44aa-9cc8-67d29e9ad2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:21.323475 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614abae5-734a-44aa-9cc8-67d29e9ad2d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:21.339795 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614abae5-734a-44aa-9cc8-67d29e9ad2d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:21.341265 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614abae5-734a-44aa-9cc8-67d29e9ad2d1 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:21.359767 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-614abae5-734a-44aa-9cc8-67d29e9ad2d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:21.359767 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:21.359767 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:21.359767 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:21.359767 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:21.359767 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:21.359767 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:21.359767 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:21.359767 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:21.359767 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:21.359767 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:21.359767 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:21.359767 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:43:21.359767 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:43:21.359767 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:43:21.359767 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:43:21.360793 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:21.360793 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:21.360793 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:21.360793 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:21.360793 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:21.360793 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:21.360793 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:21.360793 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:21.360793 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:21.360793 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:21.360793 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:21.360793 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:21.360793 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:21.360793 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:21.360793 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:21.360793 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:21.360793 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:43:21.361694 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:43:21.361694 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:21.361694 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:21.361694 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 270/550] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:43:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:21.367178 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a9bd9-c088-4693-9353-400fff66d02c None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:21.389423 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52259fd-7364-40a8-87b9-57e74ec8321d None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:21.389965 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52259fd-7364-40a8-87b9-57e74ec8321d None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:21.389965 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52259fd-7364-40a8-87b9-57e74ec8321d None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:21.391297 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 271/551] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:43:21.396437 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271acb64-ee7d-4f0d-9a57-9207a8cd702a None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:21.396715 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271acb64-ee7d-4f0d-9a57-9207a8cd702a None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:21.396985 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271acb64-ee7d-4f0d-9a57-9207a8cd702a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:21.422539 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-271acb64-ee7d-4f0d-9a57-9207a8cd702a None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:21.423741 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-271acb64-ee7d-4f0d-9a57-9207a8cd702a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:21.453622 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:21.453935 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:21.539444 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343a9bd9-c088-4693-9353-400fff66d02c None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:21.567013 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 272/552] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:21 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 23 00:43:21.592601 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd653f-286c-4263-953e-9a4c4618dbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:21.593280 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd653f-286c-4263-953e-9a4c4618dbd9 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:21.593557 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd653f-286c-4263-953e-9a4c4618dbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:21.593869 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd653f-286c-4263-953e-9a4c4618dbd9 None admin] PATH_INFO: `/v3/domains` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:21.594621 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd653f-286c-4263-953e-9a4c4618dbd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:21.594928 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd653f-286c-4263-953e-9a4c4618dbd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:21.596357 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd653f-286c-4263-953e-9a4c4618dbd9 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:21.610382 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 281/553] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:43:21.615986 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271acb64-ee7d-4f0d-9a57-9207a8cd702a None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:21.727639 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271acb64-ee7d-4f0d-9a57-9207a8cd702a None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:21.775126 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef062a-2e5e-4f63-b85c-5d779e629792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:21.775782 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef062a-2e5e-4f63-b85c-5d779e629792 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:21.776059 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef062a-2e5e-4f63-b85c-5d779e629792 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:21.776336 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef062a-2e5e-4f63-b85c-5d779e629792 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:21.787373 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef062a-2e5e-4f63-b85c-5d779e629792 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:21.788839 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef062a-2e5e-4f63-b85c-5d779e629792 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:21.800267 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be54a28-3565-40fe-b61c-c7783168c152 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:21.800549 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be54a28-3565-40fe-b61c-c7783168c152 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:21.800832 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be54a28-3565-40fe-b61c-c7783168c152 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:21.802826 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 282/554] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:43:21.808238 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-e2ef062a-2e5e-4f63-b85c-5d779e629792 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 23 00:43:21.808238 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:21.808238 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:21.808238 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:21.808238 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:21.808238 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:21.808238 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:21.808238 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:21.808238 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:21.808238 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:21.808238 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:21.808238 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:21.808238 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 00:43:21.808238 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 00:43:21.808238 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 00:43:21.808238 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 00:43:21.810032 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:21.810032 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:21.810032 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:43:21.810032 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:43:21.810032 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:43:21.810032 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:43:21.810032 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:21.810032 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:21.810032 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:21.810032 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:21.810032 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:21.810032 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:21.810032 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:21.810032 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:21.810032 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:21.810032 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:21.810032 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:21.810032 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:21.811355 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:21.811355 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:21.811355 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 00:43:21.811355 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 00:43:21.811355 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 00:43:21.811355 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 00:43:21.811355 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 00:43:21.811355 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 00:43:21.811355 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 23 00:43:21.811355 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:21.811355 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 273/555] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 23 00:43:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:21.814639 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be54a28-3565-40fe-b61c-c7783168c152 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:21.824088 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ff1ba-b57d-4b5c-9043-a37c22a46a87 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:21.824367 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ff1ba-b57d-4b5c-9043-a37c22a46a87 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:21.824647 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ff1ba-b57d-4b5c-9043-a37c22a46a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:21.850701 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:21.861125 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-5e9ff1ba-b57d-4b5c-9043-a37c22a46a87 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:21.862300 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-5e9ff1ba-b57d-4b5c-9043-a37c22a46a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:21.948310 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 274/556] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:21 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 23 00:43:21.949508 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ff1ba-b57d-4b5c-9043-a37c22a46a87 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:21.975131 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be54a28-3565-40fe-b61c-c7783168c152 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:21.982620 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:22.035879 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ba5ce-c2c7-4216-b85d-69dc2778bdbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:22.037441 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ba5ce-c2c7-4216-b85d-69dc2778bdbb None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:22.038166 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ba5ce-c2c7-4216-b85d-69dc2778bdbb None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:22.038752 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ba5ce-c2c7-4216-b85d-69dc2778bdbb None admin] PATH_INFO: `/v3/users` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:22.040163 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ba5ce-c2c7-4216-b85d-69dc2778bdbb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:22.040808 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ba5ce-c2c7-4216-b85d-69dc2778bdbb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:22.042703 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ba5ce-c2c7-4216-b85d-69dc2778bdbb None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:22.083776 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 283/557] 10.222.0.23 () {56 vars in 1135 bytes} [Sun Oct 23 00:43:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:22.088198 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ba5ce-c2c7-4216-b85d-69dc2778bdbb None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:22.090553 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ff1ba-b57d-4b5c-9043-a37c22a46a87 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:22.165865 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ae325-2269-4b74-841c-7ac6d9c03eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:22.166542 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ae325-2269-4b74-841c-7ac6d9c03eaf None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:22.166826 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ae325-2269-4b74-841c-7ac6d9c03eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:22.167086 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ae325-2269-4b74-841c-7ac6d9c03eaf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:22.178544 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:22.186962 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ae325-2269-4b74-841c-7ac6d9c03eaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:43:22.195252 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-b41ae325-2269-4b74-841c-7ac6d9c03eaf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:43:22.195252 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:22.195252 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:22.195252 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:22.195252 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:22.195252 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:22.195252 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:22.195252 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:22.195252 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:22.195252 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:22.195252 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:22.195252 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:22.195252 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:43:22.195252 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:43:22.195252 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:43:22.195252 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:43:22.196394 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:43:22.196394 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:43:22.196394 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:43:22.196394 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:43:22.196394 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:22.196394 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:22.196394 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:22.196394 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:22.196394 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:22.196394 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:22.196394 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:22.196394 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:22.196394 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:22.196394 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:22.196394 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:22.196394 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:22.197421 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:22.197421 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:22.197421 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:22.197421 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:22.197421 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:43:22.197421 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:43:22.197421 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:43:22.197421 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:43:22.197421 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:43:22.197421 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:43:22.197421 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:43:22.197421 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:22.202442 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 275/558] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 23 00:43:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:22.205652 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ae325-2269-4b74-841c-7ac6d9c03eaf None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:22.283336 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ba5ce-c2c7-4216-b85d-69dc2778bdbb None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:22.322888 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c14d562-e26b-4b31-9067-006b461c75c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:22.323639 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14d562-e26b-4b31-9067-006b461c75c7 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:22.324023 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14d562-e26b-4b31-9067-006b461c75c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:22.324403 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14d562-e26b-4b31-9067-006b461c75c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:22.336070 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c14d562-e26b-4b31-9067-006b461c75c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:22.337740 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c14d562-e26b-4b31-9067-006b461c75c7 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:22.345360 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ae325-2269-4b74-841c-7ac6d9c03eaf None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:22.353526 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-3c14d562-e26b-4b31-9067-006b461c75c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:22.353526 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:22.353526 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:22.353526 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:22.353526 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:22.353526 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:22.353526 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:22.353526 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:22.353526 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:22.353526 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:22.353526 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:22.353526 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:22.353526 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:43:22.353526 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:43:22.353526 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:43:22.353526 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:43:22.354770 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:22.354770 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:22.354770 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:22.354770 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:22.354770 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:22.354770 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:22.354770 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:22.354770 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:22.354770 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:22.354770 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:22.354770 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:22.354770 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:22.354770 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:22.354770 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:22.354770 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:22.354770 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:22.354770 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:43:22.355807 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:43:22.355807 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:22.355807 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:22.356731 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 284/559] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:43:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:22.357578 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c14d562-e26b-4b31-9067-006b461c75c7 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:22.375440 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:22.385668 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407536f-f7c4-4bc6-8842-415a7937e291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:22.386598 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407536f-f7c4-4bc6-8842-415a7937e291 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:22.387090 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407536f-f7c4-4bc6-8842-415a7937e291 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:22.387598 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407536f-f7c4-4bc6-8842-415a7937e291 None admin] PATH_INFO: `/v3/roles` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:22.388506 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407536f-f7c4-4bc6-8842-415a7937e291 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:22.389061 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407536f-f7c4-4bc6-8842-415a7937e291 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:22.390682 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407536f-f7c4-4bc6-8842-415a7937e291 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:22.400216 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 276/560] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 23 00:43:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:43:22.401316 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407536f-f7c4-4bc6-8842-415a7937e291 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:22.466168 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:22.487859 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c14d562-e26b-4b31-9067-006b461c75c7 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:22.520993 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407536f-f7c4-4bc6-8842-415a7937e291 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:22.536783 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefd328-e529-44d7-bfba-31187d4e19e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:22.537476 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefd328-e529-44d7-bfba-31187d4e19e9 None admin] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:22.537877 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefd328-e529-44d7-bfba-31187d4e19e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:22.538242 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefd328-e529-44d7-bfba-31187d4e19e9 None admin] PATH_INFO: `/v3/services` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:22.538960 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faefd328-e529-44d7-bfba-31187d4e19e9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:22.540496 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faefd328-e529-44d7-bfba-31187d4e19e9 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:22.560091 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 285/561] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Oct 23 00:43:22 2022] POST /identity/v3/services => generated 240 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:43:22.561112 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefd328-e529-44d7-bfba-31187d4e19e9 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:22.569821 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b1caf-c12a-4c47-a4f7-93300a9500c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:22.570798 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b1caf-c12a-4c47-a4f7-93300a9500c2 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:22.571264 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b1caf-c12a-4c47-a4f7-93300a9500c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:22.571749 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b1caf-c12a-4c47-a4f7-93300a9500c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:22.572736 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b1caf-c12a-4c47-a4f7-93300a9500c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:22.573262 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b1caf-c12a-4c47-a4f7-93300a9500c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:22.575040 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b1caf-c12a-4c47-a4f7-93300a9500c2 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:22.590856 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 277/562] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:22.597796 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b1caf-c12a-4c47-a4f7-93300a9500c2 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:22.656344 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:22.686954 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefd328-e529-44d7-bfba-31187d4e19e9 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:22.725730 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c80fb-4b8f-414b-8877-430a3717ef41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:22.726385 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c80fb-4b8f-414b-8877-430a3717ef41 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:22.726605 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c80fb-4b8f-414b-8877-430a3717ef41 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:22.726878 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c80fb-4b8f-414b-8877-430a3717ef41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:22.732149 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b1caf-c12a-4c47-a4f7-93300a9500c2 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:22.738960 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592c80fb-4b8f-414b-8877-430a3717ef41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:22.740556 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592c80fb-4b8f-414b-8877-430a3717ef41 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:22.750615 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:22.757125 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-592c80fb-4b8f-414b-8877-430a3717ef41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:22.757125 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:22.757125 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:22.757125 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:22.757125 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:22.757125 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:22.757125 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:22.757125 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:22.757125 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:22.757125 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:22.757125 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:22.757125 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:22.757125 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:43:22.757125 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:43:22.757125 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:43:22.757125 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:43:22.758194 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:22.758194 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:22.758194 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:22.758194 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:22.758194 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:22.758194 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:22.758194 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:22.758194 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:22.758194 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:22.758194 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:22.758194 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:22.758194 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:22.758194 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:22.758194 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:22.758194 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:22.758194 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:22.758194 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:43:22.759703 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:43:22.759703 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:22.759703 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:22.759703 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 286/563] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:43:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:22.772865 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c80fb-4b8f-414b-8877-430a3717ef41 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:22.779451 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726246f-1b33-4678-b9bc-78489de07cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:22.780524 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726246f-1b33-4678-b9bc-78489de07cbe None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:22.781005 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726246f-1b33-4678-b9bc-78489de07cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:22.781476 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726246f-1b33-4678-b9bc-78489de07cbe None admin] PATH_INFO: `/v3/projects/service` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:22.789574 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726246f-1b33-4678-b9bc-78489de07cbe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:22.791551 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726246f-1b33-4678-b9bc-78489de07cbe None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:22.805949 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-8726246f-1b33-4678-b9bc-78489de07cbe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:43:22.805949 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:22.805949 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:22.805949 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:22.805949 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:22.805949 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:22.805949 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:22.805949 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:22.805949 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:22.805949 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:22.805949 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:22.805949 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:22.805949 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 00:43:22.805949 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 00:43:22.805949 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 00:43:22.806985 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 00:43:22.806985 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:22.806985 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:22.806985 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:22.806985 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:22.806985 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:22.806985 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:22.806985 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:22.806985 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:22.806985 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:22.806985 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:22.806985 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:22.806985 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:22.806985 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:22.806985 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:22.806985 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:22.806985 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:22.807893 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 00:43:22.807893 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 00:43:22.807893 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 00:43:22.807893 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 00:43:22.807893 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 00:43:22.807893 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 00:43:22.807893 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:43:22.807893 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:22.810833 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 278/564] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 23 00:43:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:22.818024 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726246f-1b33-4678-b9bc-78489de07cbe None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:22.943908 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726246f-1b33-4678-b9bc-78489de07cbe None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:22.946094 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c80fb-4b8f-414b-8877-430a3717ef41 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:22.973910 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:22.985715 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391e28f-2069-4e4e-b4da-3f27ec114fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:22.986004 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c8d086-747c-41b9-9c7c-2ffff67c32d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:22.986295 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391e28f-2069-4e4e-b4da-3f27ec114fb4 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:22.986578 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8d086-747c-41b9-9c7c-2ffff67c32d9 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:22.986694 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391e28f-2069-4e4e-b4da-3f27ec114fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:22.986847 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391e28f-2069-4e4e-b4da-3f27ec114fb4 None admin] PATH_INFO: `/v3/projects` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:22.986938 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8d086-747c-41b9-9c7c-2ffff67c32d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:22.987119 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8d086-747c-41b9-9c7c-2ffff67c32d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:22.987540 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6391e28f-2069-4e4e-b4da-3f27ec114fb4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:22.987759 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c8d086-747c-41b9-9c7c-2ffff67c32d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:22.987863 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6391e28f-2069-4e4e-b4da-3f27ec114fb4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:22.988061 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c8d086-747c-41b9-9c7c-2ffff67c32d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:22.989822 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6391e28f-2069-4e4e-b4da-3f27ec114fb4 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:22.989980 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c8d086-747c-41b9-9c7c-2ffff67c32d9 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:23.003340 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 279/565] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 23 00:43:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:43:23.007870 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689f912-8d0f-48fe-b952-bda15249c9ce None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:23.007870 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689f912-8d0f-48fe-b952-bda15249c9ce None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:23.007870 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689f912-8d0f-48fe-b952-bda15249c9ce None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:23.007870 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 280/566] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:43:23.008638 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 287/567] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:23.009000 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689f912-8d0f-48fe-b952-bda15249c9ce None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:23.014109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601a70c-1cf0-445d-b171-f2695074e565 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:23.014420 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601a70c-1cf0-445d-b171-f2695074e565 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:23.014745 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601a70c-1cf0-445d-b171-f2695074e565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:23.042942 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-4601a70c-1cf0-445d-b171-f2695074e565 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:23.044829 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-4601a70c-1cf0-445d-b171-f2695074e565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:23.052679 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:23.128856 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689f912-8d0f-48fe-b952-bda15249c9ce None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:23.146170 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 288/568] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 00:43:23.147142 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601a70c-1cf0-445d-b171-f2695074e565 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:23.190642 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466c387-a1cb-482b-a3d2-0c8387cdde1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:23.191354 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466c387-a1cb-482b-a3d2-0c8387cdde1b None admin] REQUEST_METHOD: `PUT` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:23.191639 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466c387-a1cb-482b-a3d2-0c8387cdde1b None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:23.191980 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466c387-a1cb-482b-a3d2-0c8387cdde1b None admin] PATH_INFO: `/v3/projects/60f8594760e44ce3888a32702ea9afcc/users/84a0345be05644e3a7a71c5a2bf21c41/roles/1e2073be75174689aa4fac29e674583d` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:23.194974 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6466c387-a1cb-482b-a3d2-0c8387cdde1b None admin] RBAC: Authorizing `identity:create_grant(project_id=60f8594760e44ce3888a32702ea9afcc, user_id=84a0345be05644e3a7a71c5a2bf21c41, role_id=1e2073be75174689aa4fac29e674583d)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:23.198314 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6466c387-a1cb-482b-a3d2-0c8387cdde1b None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:23.220564 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 281/569] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 23 00:43:23 2022] PUT /identity/v3/projects/60f8594760e44ce3888a32702ea9afcc/users/84a0345be05644e3a7a71c5a2bf21c41/roles/1e2073be75174689aa4fac29e674583d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:43:23.324598 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601a70c-1cf0-445d-b171-f2695074e565 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:23.351186 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:23.363724 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c93f7-f313-48f3-99a6-45b20fcf9dd2 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:23.364614 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c93f7-f313-48f3-99a6-45b20fcf9dd2 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:23.364845 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c93f7-f313-48f3-99a6-45b20fcf9dd2 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:23.367743 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 282/570] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:43:23.372251 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ce278-f429-44ad-a86f-27589b1c5ff5 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:23.372548 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ce278-f429-44ad-a86f-27589b1c5ff5 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:23.372797 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ce278-f429-44ad-a86f-27589b1c5ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:23.374515 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a9b4f-99c6-4701-bbe1-62398d5f083c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:23.375164 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a9b4f-99c6-4701-bbe1-62398d5f083c None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:23.375452 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a9b4f-99c6-4701-bbe1-62398d5f083c None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:23.375726 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a9b4f-99c6-4701-bbe1-62398d5f083c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:23.384155 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357a9b4f-99c6-4701-bbe1-62398d5f083c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:23.385620 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357a9b4f-99c6-4701-bbe1-62398d5f083c None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:23.393112 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-8c1ce278-f429-44ad-a86f-27589b1c5ff5 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:23.395112 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-8c1ce278-f429-44ad-a86f-27589b1c5ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:23.399665 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-357a9b4f-99c6-4701-bbe1-62398d5f083c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 23 00:43:23.399665 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:23.399665 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:23.399665 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:23.399665 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:23.399665 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:23.399665 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:23.399665 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:23.399665 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:23.399665 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:23.399665 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:23.399665 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:23.399665 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 00:43:23.399665 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 00:43:23.399665 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 00:43:23.399665 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 00:43:23.400647 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:23.400647 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:23.400647 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:43:23.400647 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:43:23.400647 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:43:23.400647 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:43:23.400647 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:23.400647 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:23.400647 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:23.400647 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:23.400647 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:23.400647 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:23.400647 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:23.400647 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:23.400647 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:23.400647 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:23.400647 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:23.400647 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:23.406466 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:23.406466 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:23.406466 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 00:43:23.406466 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 00:43:23.406466 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 00:43:23.406466 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 00:43:23.406466 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 00:43:23.406466 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 00:43:23.406466 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 23 00:43:23.406466 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:23.406466 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 289/571] 10.222.0.23 () {56 vars in 1093 bytes} [Sun Oct 23 00:43:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:23.407105 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a9b4f-99c6-4701-bbe1-62398d5f083c None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:23.501300 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 283/572] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 00:43:23.503413 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ce278-f429-44ad-a86f-27589b1c5ff5 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:23.528659 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a9b4f-99c6-4701-bbe1-62398d5f083c None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:23.529401 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:23.564529 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9601632-b97c-415a-ac05-86868dde1ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:23.565508 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9601632-b97c-415a-ac05-86868dde1ff2 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:23.565994 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9601632-b97c-415a-ac05-86868dde1ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:23.566543 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9601632-b97c-415a-ac05-86868dde1ff2 None admin] PATH_INFO: `/v3/users` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:23.568033 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9601632-b97c-415a-ac05-86868dde1ff2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:23.568560 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9601632-b97c-415a-ac05-86868dde1ff2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:23.570231 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9601632-b97c-415a-ac05-86868dde1ff2 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:23.588791 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 290/573] 10.222.0.23 () {56 vars in 1133 bytes} [Sun Oct 23 00:43:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:43:23.595053 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9601632-b97c-415a-ac05-86868dde1ff2 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:23.628684 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ce278-f429-44ad-a86f-27589b1c5ff5 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:23.639412 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:23.667548 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c1710-0b06-4b65-b4b6-e399ee212cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:23.668147 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c1710-0b06-4b65-b4b6-e399ee212cd0 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:23.668426 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c1710-0b06-4b65-b4b6-e399ee212cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:23.668700 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c1710-0b06-4b65-b4b6-e399ee212cd0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:23.680390 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c1710-0b06-4b65-b4b6-e399ee212cd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:43:23.699322 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-a62c1710-0b06-4b65-b4b6-e399ee212cd0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:43:23.699322 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:23.699322 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:23.699322 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:23.699322 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:23.699322 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:23.699322 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:23.699322 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:23.699322 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:23.699322 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:23.699322 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:23.699322 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:23.699322 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:43:23.699322 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:43:23.699322 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:43:23.699322 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:43:23.700409 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:43:23.700409 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:43:23.700409 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:43:23.700409 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:43:23.700409 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:23.700409 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:23.700409 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:23.700409 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:23.700409 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:23.700409 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:23.700409 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:23.700409 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:23.700409 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:23.700409 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:23.700409 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:23.700409 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:23.701246 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:23.701246 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:23.701246 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:23.701246 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:23.701246 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:43:23.701246 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:43:23.701246 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:43:23.701246 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:43:23.701246 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:43:23.701246 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:43:23.701246 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:43:23.701246 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:23.701246 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 284/574] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 23 00:43:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:23.706997 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c1710-0b06-4b65-b4b6-e399ee212cd0 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:23.714606 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9601632-b97c-415a-ac05-86868dde1ff2 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:23.750522 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef4309-8bf4-4631-b670-887bf91567a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:23.751484 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef4309-8bf4-4631-b670-887bf91567a9 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:23.751995 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef4309-8bf4-4631-b670-887bf91567a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:23.752470 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef4309-8bf4-4631-b670-887bf91567a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:23.822804 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cef4309-8bf4-4631-b670-887bf91567a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:23.824683 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cef4309-8bf4-4631-b670-887bf91567a9 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:23.829515 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:23.838421 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c1710-0b06-4b65-b4b6-e399ee212cd0 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:23.873578 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:23.878170 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a6348-50eb-4584-bc06-099285bc2e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:23.878793 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a6348-50eb-4584-bc06-099285bc2e4e None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:23.879078 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a6348-50eb-4584-bc06-099285bc2e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:23.879355 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a6348-50eb-4584-bc06-099285bc2e4e None admin] PATH_INFO: `/v3/roles` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:23.880863 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5a6348-50eb-4584-bc06-099285bc2e4e None admin] RBAC: Adding query filter params (name=service) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:23.881173 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5a6348-50eb-4584-bc06-099285bc2e4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:23.882708 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5a6348-50eb-4584-bc06-099285bc2e4e None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:23.891684 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 285/575] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Oct 23 00:43:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:23.899333 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a6348-50eb-4584-bc06-099285bc2e4e None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:23.981797 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 291/576] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 23 00:43:23 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 23 00:43:23.982713 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef4309-8bf4-4631-b670-887bf91567a9 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:24.011911 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a6348-50eb-4584-bc06-099285bc2e4e None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:24.046954 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e1b41-6562-4c41-9cc4-e8fc21cf8f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:24.047698 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e1b41-6562-4c41-9cc4-e8fc21cf8f7e None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:24.047992 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e1b41-6562-4c41-9cc4-e8fc21cf8f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:24.048274 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e1b41-6562-4c41-9cc4-e8fc21cf8f7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:24.059754 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e1b41-6562-4c41-9cc4-e8fc21cf8f7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:24.061949 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e1b41-6562-4c41-9cc4-e8fc21cf8f7e None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:24.078637 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-1d3e1b41-6562-4c41-9cc4-e8fc21cf8f7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:24.078637 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:24.078637 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:24.078637 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:24.078637 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:24.078637 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:24.078637 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:24.078637 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:24.078637 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:24.078637 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:24.078637 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:24.078637 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:24.078637 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:43:24.078637 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:43:24.078637 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:43:24.078637 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:43:24.079803 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:24.079803 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:24.079803 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:24.079803 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:24.079803 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:24.079803 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:24.079803 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:24.079803 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:24.079803 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:24.079803 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:24.079803 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:24.079803 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:24.079803 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:24.079803 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:24.079803 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:24.079803 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:24.079803 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:43:24.080888 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:43:24.080888 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:24.080888 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:24.081484 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:24.085110 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 286/577] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:43:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:24.085933 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e1b41-6562-4c41-9cc4-e8fc21cf8f7e None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:24.116613 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef4309-8bf4-4631-b670-887bf91567a9 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:24.166499 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c6609-af41-4fc0-9a07-3ec736df32e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:24.167052 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c6609-af41-4fc0-9a07-3ec736df32e5 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:24.167334 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c6609-af41-4fc0-9a07-3ec736df32e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:24.167610 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c6609-af41-4fc0-9a07-3ec736df32e5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:24.168197 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c6609-af41-4fc0-9a07-3ec736df32e5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:24.169560 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c6609-af41-4fc0-9a07-3ec736df32e5 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:24.171737 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:24.179269 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-a96c6609-af41-4fc0-9a07-3ec736df32e5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 23 00:43:24.179269 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:24.179269 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:43:24.179269 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:43:24.179269 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:43:24.179269 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:43:24.179269 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:43:24.179269 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:43:24.179269 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 23 00:43:24.179269 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:24.179269 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:43:24.179269 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:24.179269 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:24.179269 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:24.179269 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:24.179269 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:24.179269 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:24.180275 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:24.180275 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:24.180275 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:24.180275 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:24.180275 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:24.180275 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:24.180275 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:43:24.180275 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:43:24.180275 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:43:24.180275 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:43:24.180275 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:24.180275 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:24.180275 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:24.180275 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:24.180275 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:24.180275 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:24.181126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:24.181126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:24.181126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:24.181126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:24.181126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:24.181126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:24.181126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:24.181126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:24.181126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:24.181126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:24.181126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:43:24.181126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:43:24.181126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 23 00:43:24.181126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:24.185586 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 292/578] 10.222.0.23 () {56 vars in 1129 bytes} [Sun Oct 23 00:43:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:24.186179 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c6609-af41-4fc0-9a07-3ec736df32e5 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:24.220049 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e1b41-6562-4c41-9cc4-e8fc21cf8f7e None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:24.263637 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d2d55-51a5-449d-bb45-27448d2d3374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:24.264900 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d2d55-51a5-449d-bb45-27448d2d3374 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:24.265406 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d2d55-51a5-449d-bb45-27448d2d3374 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:24.266000 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d2d55-51a5-449d-bb45-27448d2d3374 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:24.278681 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d2d55-51a5-449d-bb45-27448d2d3374 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:24.281262 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d2d55-51a5-449d-bb45-27448d2d3374 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:24.298463 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-532d2d55-51a5-449d-bb45-27448d2d3374 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:24.298463 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:24.298463 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:24.298463 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:24.298463 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:24.298463 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:24.298463 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:24.298463 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:24.298463 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:24.298463 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:24.298463 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:24.298463 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:24.298463 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:43:24.298463 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:43:24.298463 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:43:24.298463 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:43:24.299584 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:24.299584 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:24.299584 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:24.299584 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:24.299584 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:24.299584 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:24.299584 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:24.299584 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:24.299584 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:24.299584 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:24.299584 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:24.299584 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:24.299584 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:24.299584 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:24.299584 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:24.299584 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:24.299584 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:43:24.300533 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:43:24.300533 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:24.300533 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:24.300706 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c6609-af41-4fc0-9a07-3ec736df32e5 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:24.302922 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 287/579] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:43:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:24.303928 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d2d55-51a5-449d-bb45-27448d2d3374 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:24.342531 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d08643-3493-46c6-afd0-ac42e1d1f66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:24.343199 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d08643-3493-46c6-afd0-ac42e1d1f66b None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:24.343485 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d08643-3493-46c6-afd0-ac42e1d1f66b None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:24.343759 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d08643-3493-46c6-afd0-ac42e1d1f66b None admin] PATH_INFO: `/v3/domains` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:24.344428 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d08643-3493-46c6-afd0-ac42e1d1f66b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:24.344718 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d08643-3493-46c6-afd0-ac42e1d1f66b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:24.346115 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d08643-3493-46c6-afd0-ac42e1d1f66b None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:24.364365 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 293/580] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:43:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:24.365269 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d08643-3493-46c6-afd0-ac42e1d1f66b None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:24.378441 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:24.428468 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:24.434018 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d2d55-51a5-449d-bb45-27448d2d3374 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:24.474466 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1605f06-51a6-4378-8f5f-471a236fb721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:24.475430 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1605f06-51a6-4378-8f5f-471a236fb721 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:24.475946 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1605f06-51a6-4378-8f5f-471a236fb721 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:24.476422 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1605f06-51a6-4378-8f5f-471a236fb721 None admin] PATH_INFO: `/v3/services` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:24.477769 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1605f06-51a6-4378-8f5f-471a236fb721 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:24.478321 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1605f06-51a6-4378-8f5f-471a236fb721 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:24.480185 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1605f06-51a6-4378-8f5f-471a236fb721 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:24.485818 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 288/581] 10.222.0.23 () {56 vars in 1124 bytes} [Sun Oct 23 00:43:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:24.486834 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1605f06-51a6-4378-8f5f-471a236fb721 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:24.522021 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d08643-3493-46c6-afd0-ac42e1d1f66b None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:24.599355 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659bf7d2-f82b-4bb3-9037-d4a34694b194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:24.600750 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659bf7d2-f82b-4bb3-9037-d4a34694b194 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:24.601257 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659bf7d2-f82b-4bb3-9037-d4a34694b194 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:24.601730 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659bf7d2-f82b-4bb3-9037-d4a34694b194 None admin] PATH_INFO: `/v3/domains` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:24.602671 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659bf7d2-f82b-4bb3-9037-d4a34694b194 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:24.605066 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659bf7d2-f82b-4bb3-9037-d4a34694b194 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:24.606977 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659bf7d2-f82b-4bb3-9037-d4a34694b194 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:24.635113 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 294/582] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:43:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:24.636286 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659bf7d2-f82b-4bb3-9037-d4a34694b194 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:24.658289 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1605f06-51a6-4378-8f5f-471a236fb721 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:24.689458 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:24.730687 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5724bc6f-6027-4a92-8f57-5aba13966c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:24.731773 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724bc6f-6027-4a92-8f57-5aba13966c81 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:24.731983 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724bc6f-6027-4a92-8f57-5aba13966c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:24.732255 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724bc6f-6027-4a92-8f57-5aba13966c81 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:24.741517 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5724bc6f-6027-4a92-8f57-5aba13966c81 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:24.742688 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5724bc6f-6027-4a92-8f57-5aba13966c81 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:24.771631 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-5724bc6f-6027-4a92-8f57-5aba13966c81 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 23 00:43:24.771631 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:24.771631 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:24.771631 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:24.771631 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:24.771631 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:24.771631 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:24.771631 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:24.771631 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:24.771631 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:24.771631 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:24.771631 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:24.771631 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 00:43:24.771631 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 00:43:24.771631 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 00:43:24.771631 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 00:43:24.772674 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:24.772674 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:24.772674 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:43:24.772674 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:43:24.772674 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:43:24.772674 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:43:24.772674 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:24.772674 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:24.772674 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:24.772674 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:24.772674 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:24.772674 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:24.772674 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:24.772674 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:24.772674 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:24.772674 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:24.772674 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:24.772674 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:24.773618 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:24.773618 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:24.773618 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 00:43:24.773618 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 00:43:24.773618 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 00:43:24.773618 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 00:43:24.773618 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 00:43:24.773618 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 00:43:24.773618 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 23 00:43:24.773618 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:24.777269 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 289/583] 10.222.0.23 () {56 vars in 1117 bytes} [Sun Oct 23 00:43:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:24.778603 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5724bc6f-6027-4a92-8f57-5aba13966c81 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:24.796991 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659bf7d2-f82b-4bb3-9037-d4a34694b194 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:24.831314 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:24.876605 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64de40a-5706-466c-8911-4e42286c6d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:24.877490 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64de40a-5706-466c-8911-4e42286c6d88 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:24.878392 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64de40a-5706-466c-8911-4e42286c6d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:24.880276 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64de40a-5706-466c-8911-4e42286c6d88 None admin] PATH_INFO: `/v3/services` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:24.881747 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64de40a-5706-466c-8911-4e42286c6d88 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:24.882420 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64de40a-5706-466c-8911-4e42286c6d88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:24.886463 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64de40a-5706-466c-8911-4e42286c6d88 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:24.910917 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 295/584] 10.222.0.23 () {56 vars in 1124 bytes} [Sun Oct 23 00:43:24 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:24.912339 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64de40a-5706-466c-8911-4e42286c6d88 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:24.965939 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5724bc6f-6027-4a92-8f57-5aba13966c81 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:25.003326 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c559c9e-866e-4f1f-8145-2556b75f1e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:25.004299 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c559c9e-866e-4f1f-8145-2556b75f1e3b None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:25.005376 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c559c9e-866e-4f1f-8145-2556b75f1e3b None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:25.005853 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c559c9e-866e-4f1f-8145-2556b75f1e3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:25.013630 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c559c9e-866e-4f1f-8145-2556b75f1e3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:25.015518 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c559c9e-866e-4f1f-8145-2556b75f1e3b None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:25.029084 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-9c559c9e-866e-4f1f-8145-2556b75f1e3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:43:25.029084 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:25.029084 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:25.029084 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:25.029084 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:25.029084 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:25.029084 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:25.029084 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:25.029084 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:25.029084 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:25.029084 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:25.029084 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:25.029084 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 00:43:25.029084 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 00:43:25.029084 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 00:43:25.030018 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 00:43:25.030018 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:25.030018 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:25.030018 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:25.030018 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:25.030018 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:25.030018 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:25.030018 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:25.030018 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:25.030018 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:25.030018 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:25.030018 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:25.030018 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:25.030018 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:25.030018 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:25.030018 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:25.030018 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:25.030935 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 00:43:25.030935 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 00:43:25.030935 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 00:43:25.030935 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 00:43:25.030935 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 00:43:25.030935 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 00:43:25.030935 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:43:25.030935 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:25.037664 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 290/585] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 23 00:43:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:25.037664 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c559c9e-866e-4f1f-8145-2556b75f1e3b None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:25.050296 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64de40a-5706-466c-8911-4e42286c6d88 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:25.076710 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:25.094962 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ecb07e-8da0-43d1-bde1-b699aeea1e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:25.095575 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ecb07e-8da0-43d1-bde1-b699aeea1e30 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:25.095856 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ecb07e-8da0-43d1-bde1-b699aeea1e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:25.096136 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ecb07e-8da0-43d1-bde1-b699aeea1e30 None admin] PATH_INFO: `/v3/users` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:25.097158 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ecb07e-8da0-43d1-bde1-b699aeea1e30 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:25.097469 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ecb07e-8da0-43d1-bde1-b699aeea1e30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:25.099636 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ecb07e-8da0-43d1-bde1-b699aeea1e30 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:25.124796 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 296/586] 10.222.0.23 () {56 vars in 1149 bytes} [Sun Oct 23 00:43:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:25.125693 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ecb07e-8da0-43d1-bde1-b699aeea1e30 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:25.159901 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c559c9e-866e-4f1f-8145-2556b75f1e3b None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:25.185108 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:25.204262 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f974c-8aa3-481d-96ed-a7b475fe22be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:25.205286 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f974c-8aa3-481d-96ed-a7b475fe22be None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:25.205804 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f974c-8aa3-481d-96ed-a7b475fe22be None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:25.206402 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f974c-8aa3-481d-96ed-a7b475fe22be None admin] PATH_INFO: `/v3/endpoints` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:25.207765 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f974c-8aa3-481d-96ed-a7b475fe22be None admin] RBAC: Adding query filter params (interface=public, service_id=266f86a078304ca9b5e3f432f537d05f, region_id=RegionOne) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:25.208836 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f974c-8aa3-481d-96ed-a7b475fe22be None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:25.211039 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f974c-8aa3-481d-96ed-a7b475fe22be None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:25.226474 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 291/587] 10.222.0.23 () {56 vars in 1251 bytes} [Sun Oct 23 00:43:25 2022] GET /identity/v3/endpoints?service_id=266f86a078304ca9b5e3f432f537d05f&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:25.227184 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f974c-8aa3-481d-96ed-a7b475fe22be None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:25.269733 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ecb07e-8da0-43d1-bde1-b699aeea1e30 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:25.315587 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492c066-adcb-409a-8eac-6455e6fc1054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:25.316690 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492c066-adcb-409a-8eac-6455e6fc1054 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:25.317033 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492c066-adcb-409a-8eac-6455e6fc1054 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:25.317310 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492c066-adcb-409a-8eac-6455e6fc1054 None admin] PATH_INFO: `/v3/projects` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:25.318306 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9492c066-adcb-409a-8eac-6455e6fc1054 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:25.318617 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9492c066-adcb-409a-8eac-6455e6fc1054 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:25.321007 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9492c066-adcb-409a-8eac-6455e6fc1054 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:25.336617 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 297/588] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 23 00:43:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:25.336617 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492c066-adcb-409a-8eac-6455e6fc1054 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:25.350276 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:25.354525 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f974c-8aa3-481d-96ed-a7b475fe22be None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:25.392774 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d49bb-8261-4f8a-b153-9be064250a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:25.393897 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d49bb-8261-4f8a-b153-9be064250a15 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:25.394211 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d49bb-8261-4f8a-b153-9be064250a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:25.394768 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d49bb-8261-4f8a-b153-9be064250a15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:25.440589 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:25.444311 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492c066-adcb-409a-8eac-6455e6fc1054 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:25.468838 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d49bb-8261-4f8a-b153-9be064250a15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:25.470358 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d49bb-8261-4f8a-b153-9be064250a15 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:25.482242 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45854510-6127-4682-bfb3-8f8d9659db1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:25.482778 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45854510-6127-4682-bfb3-8f8d9659db1f None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:25.483070 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45854510-6127-4682-bfb3-8f8d9659db1f None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:25.483346 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45854510-6127-4682-bfb3-8f8d9659db1f None admin] PATH_INFO: `/v3/services` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:25.483955 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45854510-6127-4682-bfb3-8f8d9659db1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:25.485323 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45854510-6127-4682-bfb3-8f8d9659db1f None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:25.490995 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 298/589] 10.222.0.23 () {56 vars in 1087 bytes} [Sun Oct 23 00:43:25 2022] GET /identity/v3/services => generated 772 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:25.492022 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54e457-6c27-434b-a1e5-54a2edb81d1f None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:25.492367 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54e457-6c27-434b-a1e5-54a2edb81d1f None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:25.492644 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54e457-6c27-434b-a1e5-54a2edb81d1f None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:25.494092 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 299/590] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:43:25.494738 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54e457-6c27-434b-a1e5-54a2edb81d1f None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:25.616149 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:25.620933 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 292/591] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 23 00:43:25 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 23 00:43:25.622591 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238373d-c065-4d5b-8b7a-8e632dcb5b89 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:25.622984 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238373d-c065-4d5b-8b7a-8e632dcb5b89 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:25.623382 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238373d-c065-4d5b-8b7a-8e632dcb5b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:25.643695 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-c238373d-c065-4d5b-8b7a-8e632dcb5b89 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:25.644938 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-c238373d-c065-4d5b-8b7a-8e632dcb5b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:25.645781 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54e457-6c27-434b-a1e5-54a2edb81d1f None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:25.684919 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9903a333-2804-4bb5-83c9-8d49dcf49a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:25.685528 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903a333-2804-4bb5-83c9-8d49dcf49a5f None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:25.685807 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903a333-2804-4bb5-83c9-8d49dcf49a5f None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:25.686098 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903a333-2804-4bb5-83c9-8d49dcf49a5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:25.687017 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9903a333-2804-4bb5-83c9-8d49dcf49a5f None admin] RBAC: Adding query filter params (role.id=1e2073be75174689aa4fac29e674583d, scope.project.id=60f8594760e44ce3888a32702ea9afcc, user.id=90f691140a8341ada73a8c6f01ad798c) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:25.687125 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9903a333-2804-4bb5-83c9-8d49dcf49a5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:25.688539 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9903a333-2804-4bb5-83c9-8d49dcf49a5f None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:25.695541 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 300/592] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 23 00:43:25 2022] GET /identity/v3/role_assignments?user.id=90f691140a8341ada73a8c6f01ad798c&scope.project.id=60f8594760e44ce3888a32702ea9afcc&role.id=1e2073be75174689aa4fac29e674583d => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:25.696963 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73d2ec-07c8-45bf-86e9-13298e2baf6b None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:25.697406 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73d2ec-07c8-45bf-86e9-13298e2baf6b None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:25.697832 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73d2ec-07c8-45bf-86e9-13298e2baf6b None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:25.699285 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 301/593] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:43:25.700167 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73d2ec-07c8-45bf-86e9-13298e2baf6b None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:25.735940 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 293/594] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:43:25.737610 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505fb90-e384-4df8-9075-05123ba1e7b9 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:25.737959 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505fb90-e384-4df8-9075-05123ba1e7b9 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:25.738372 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505fb90-e384-4df8-9075-05123ba1e7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:25.745491 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:25.761230 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-5505fb90-e384-4df8-9075-05123ba1e7b9 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:25.762612 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-5505fb90-e384-4df8-9075-05123ba1e7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:25.873351 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 294/595] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:43:25.888496 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73d2ec-07c8-45bf-86e9-13298e2baf6b None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:25.925637 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c204b879-9513-4751-a31c-f580f32d676b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:25.926917 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204b879-9513-4751-a31c-f580f32d676b None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:25.927207 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204b879-9513-4751-a31c-f580f32d676b None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:25.927483 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204b879-9513-4751-a31c-f580f32d676b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:25.938871 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c204b879-9513-4751-a31c-f580f32d676b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:25.940323 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c204b879-9513-4751-a31c-f580f32d676b None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:25.956031 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-c204b879-9513-4751-a31c-f580f32d676b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:25.956031 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:25.956031 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:25.956031 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:25.956031 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:25.956031 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:25.956031 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:25.956031 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:25.956031 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:25.956031 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:25.956031 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:25.956031 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:25.956031 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:43:25.956031 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:43:25.956031 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:43:25.956031 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:43:25.956968 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:25.956968 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:25.956968 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:25.956968 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:25.956968 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:25.956968 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:25.956968 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:25.956968 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:25.956968 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:25.956968 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:25.956968 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:25.956968 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:25.956968 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:25.956968 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:25.956968 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:25.956968 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:25.956968 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:43:25.957877 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:43:25.957877 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:25.957877 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:25.957877 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 302/596] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:43:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:25.964000 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5505fb90-e384-4df8-9075-05123ba1e7b9 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:26.025857 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:26.073783 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c204b879-9513-4751-a31c-f580f32d676b None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:26.074967 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5505fb90-e384-4df8-9075-05123ba1e7b9 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:26.121421 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9e13d-8bce-49a4-b55f-fca714fd16eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:26.122437 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9e13d-8bce-49a4-b55f-fca714fd16eb None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:26.122924 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9e13d-8bce-49a4-b55f-fca714fd16eb None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:26.123420 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9e13d-8bce-49a4-b55f-fca714fd16eb None admin] PATH_INFO: `/v3/domains` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:26.124297 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d9e13d-8bce-49a4-b55f-fca714fd16eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:26.124800 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d9e13d-8bce-49a4-b55f-fca714fd16eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:26.126408 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d9e13d-8bce-49a4-b55f-fca714fd16eb None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:26.140479 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 295/597] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:43:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:26.147734 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9e13d-8bce-49a4-b55f-fca714fd16eb None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:26.194162 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:26.215622 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c204b879-9513-4751-a31c-f580f32d676b None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:26.262932 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f3829-0e6e-4aba-b5c5-092a9adf517e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:26.264014 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f3829-0e6e-4aba-b5c5-092a9adf517e None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:26.264502 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f3829-0e6e-4aba-b5c5-092a9adf517e None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:26.265198 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f3829-0e6e-4aba-b5c5-092a9adf517e None admin] PATH_INFO: `/v3/services/network` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:26.266025 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f3829-0e6e-4aba-b5c5-092a9adf517e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:26.268040 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f3829-0e6e-4aba-b5c5-092a9adf517e None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:26.280810 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9e13d-8bce-49a4-b55f-fca714fd16eb None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:26.281421 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-af2f3829-0e6e-4aba-b5c5-092a9adf517e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 23 00:43:26.281421 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:26.281421 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:43:26.281421 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:43:26.281421 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:43:26.281421 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:43:26.281421 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:43:26.281421 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:43:26.281421 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 23 00:43:26.281421 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:26.281421 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:43:26.281421 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:26.281421 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:26.281421 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:26.281421 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:26.281421 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:26.281421 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:26.282689 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:26.282689 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:26.282689 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:26.282689 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:26.282689 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:26.282689 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:26.282689 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:43:26.282689 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:43:26.282689 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:43:26.282689 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:43:26.282689 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:26.282689 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:26.282689 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:26.282689 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:26.282689 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:26.282689 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:26.283776 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:26.283776 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:26.283776 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:26.283776 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:26.283776 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:26.283776 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:26.283776 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:26.283776 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:26.283776 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:26.283776 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:26.283776 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:43:26.283776 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:43:26.283776 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 23 00:43:26.283776 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:26.290165 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 303/598] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 23 00:43:26 2022] GET /identity/v3/services/network => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:43:26.291588 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f3829-0e6e-4aba-b5c5-092a9adf517e None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:26.318446 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:26.332327 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7f055-b437-49c4-ad8c-dc7a5e19fa76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:26.333744 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7f055-b437-49c4-ad8c-dc7a5e19fa76 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:26.334206 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7f055-b437-49c4-ad8c-dc7a5e19fa76 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:26.334625 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7f055-b437-49c4-ad8c-dc7a5e19fa76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:26.344049 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e7f055-b437-49c4-ad8c-dc7a5e19fa76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:26.346531 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e7f055-b437-49c4-ad8c-dc7a5e19fa76 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:26.361252 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-03e7f055-b437-49c4-ad8c-dc7a5e19fa76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:43:26.361252 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:26.361252 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:26.361252 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:26.361252 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:26.361252 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:26.361252 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:26.361252 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:26.361252 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:26.361252 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:26.361252 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:26.361252 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:26.361252 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 00:43:26.361252 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 00:43:26.361252 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 00:43:26.362439 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 00:43:26.362439 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:26.362439 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:26.362439 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:26.362439 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:26.362439 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:26.362439 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:26.362439 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:26.362439 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:26.362439 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:26.362439 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:26.362439 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:26.362439 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:26.362439 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:26.362439 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:26.362439 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:26.362439 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:26.363557 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 00:43:26.363557 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 00:43:26.363557 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 00:43:26.363557 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 00:43:26.363557 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 00:43:26.363557 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 00:43:26.363557 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:43:26.363557 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:26.369640 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 296/599] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 23 00:43:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:26.370634 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7f055-b437-49c4-ad8c-dc7a5e19fa76 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:26.418388 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f3829-0e6e-4aba-b5c5-092a9adf517e None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:26.454062 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5aa1ed-1d93-40ea-88ef-a4a954d78e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:26.454924 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5aa1ed-1d93-40ea-88ef-a4a954d78e5c None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:26.455306 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5aa1ed-1d93-40ea-88ef-a4a954d78e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:26.456258 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5aa1ed-1d93-40ea-88ef-a4a954d78e5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:26.466832 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5aa1ed-1d93-40ea-88ef-a4a954d78e5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:43:26.472569 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-ee5aa1ed-1d93-40ea-88ef-a4a954d78e5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:43:26.472569 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:26.472569 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:26.472569 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:26.472569 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:26.472569 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:26.472569 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:26.472569 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:26.472569 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:26.472569 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:26.472569 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:26.472569 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:26.472569 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:43:26.472569 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:43:26.472569 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:43:26.472569 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:43:26.474149 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:43:26.474149 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:43:26.474149 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:43:26.474149 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:43:26.474149 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:26.474149 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:26.474149 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:26.474149 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:26.474149 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:26.474149 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:26.474149 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:26.474149 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:26.474149 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:26.474149 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:26.474149 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:26.474149 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:26.475004 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:26.475004 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:26.475004 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:26.475004 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:26.475004 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:43:26.475004 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:43:26.475004 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:43:26.475004 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:43:26.475004 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:43:26.475004 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:43:26.475004 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:43:26.475004 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:26.475004 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 304/600] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 23 00:43:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:26.475680 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5aa1ed-1d93-40ea-88ef-a4a954d78e5c None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:26.480733 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:26.499115 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7f055-b437-49c4-ad8c-dc7a5e19fa76 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:26.536815 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a8a8d-269e-4564-8b32-e8faddcb5b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:26.537762 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a8a8d-269e-4564-8b32-e8faddcb5b9c None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:26.538446 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a8a8d-269e-4564-8b32-e8faddcb5b9c None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:26.538936 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a8a8d-269e-4564-8b32-e8faddcb5b9c None admin] PATH_INFO: `/v3/services` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:26.540391 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a8a8d-269e-4564-8b32-e8faddcb5b9c None admin] RBAC: Adding query filter params (name=network) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:26.540921 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a8a8d-269e-4564-8b32-e8faddcb5b9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:26.542546 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a8a8d-269e-4564-8b32-e8faddcb5b9c None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:26.548420 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 297/601] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Oct 23 00:43:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:26.549568 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a8a8d-269e-4564-8b32-e8faddcb5b9c None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:26.591257 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5aa1ed-1d93-40ea-88ef-a4a954d78e5c None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:26.605839 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:26.641324 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52885ef2-26d9-4e45-ad3b-120dcbad4c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:26.642358 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52885ef2-26d9-4e45-ad3b-120dcbad4c51 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:26.643306 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52885ef2-26d9-4e45-ad3b-120dcbad4c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:26.643794 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52885ef2-26d9-4e45-ad3b-120dcbad4c51 None admin] PATH_INFO: `/v3/projects` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:26.646016 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52885ef2-26d9-4e45-ad3b-120dcbad4c51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:26.646991 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52885ef2-26d9-4e45-ad3b-120dcbad4c51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:26.649757 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52885ef2-26d9-4e45-ad3b-120dcbad4c51 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:26.667832 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 305/602] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 23 00:43:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:26.669025 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52885ef2-26d9-4e45-ad3b-120dcbad4c51 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:26.673572 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a8a8d-269e-4564-8b32-e8faddcb5b9c None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:26.715600 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66e932-e3d2-4efb-ab3b-e5874f0dbadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:26.716199 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66e932-e3d2-4efb-ab3b-e5874f0dbadf None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:26.716473 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66e932-e3d2-4efb-ab3b-e5874f0dbadf None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:26.716741 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66e932-e3d2-4efb-ab3b-e5874f0dbadf None admin] PATH_INFO: `/v3/roles` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:26.717398 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c66e932-e3d2-4efb-ab3b-e5874f0dbadf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:26.717693 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c66e932-e3d2-4efb-ab3b-e5874f0dbadf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:26.719170 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c66e932-e3d2-4efb-ab3b-e5874f0dbadf None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:26.733408 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 298/603] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 23 00:43:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:26.733408 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66e932-e3d2-4efb-ab3b-e5874f0dbadf None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:26.762713 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:26.818062 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52885ef2-26d9-4e45-ad3b-120dcbad4c51 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:26.852797 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66e932-e3d2-4efb-ab3b-e5874f0dbadf None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:26.854923 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe891e7-0e22-4e98-a779-2057ce3f8920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:26.855522 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe891e7-0e22-4e98-a779-2057ce3f8920 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:26.855805 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe891e7-0e22-4e98-a779-2057ce3f8920 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:26.856068 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe891e7-0e22-4e98-a779-2057ce3f8920 None admin] PATH_INFO: `/v3/services` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:26.856695 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:26.856947 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe891e7-0e22-4e98-a779-2057ce3f8920 None admin] RBAC: Adding query filter params (type=network) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:26.857246 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe891e7-0e22-4e98-a779-2057ce3f8920 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:26.859033 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe891e7-0e22-4e98-a779-2057ce3f8920 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:26.865641 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 306/604] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Oct 23 00:43:26 2022] GET /identity/v3/services?type=network => generated 350 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:26.866560 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe891e7-0e22-4e98-a779-2057ce3f8920 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:26.900016 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2e2d7-51f2-4ea5-9b28-f3a63ff3e1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:26.901218 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2e2d7-51f2-4ea5-9b28-f3a63ff3e1fd None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:26.902480 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2e2d7-51f2-4ea5-9b28-f3a63ff3e1fd None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:26.902615 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2e2d7-51f2-4ea5-9b28-f3a63ff3e1fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:26.905872 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f2e2d7-51f2-4ea5-9b28-f3a63ff3e1fd None admin] RBAC: Adding query filter params (role.id=832e4b25a75c4d30a010d6803a5a4577, scope.project.id=60f8594760e44ce3888a32702ea9afcc, user.id=f183fd83a96a4af0bc9df03e6f61ca4a) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:26.906426 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f2e2d7-51f2-4ea5-9b28-f3a63ff3e1fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:26.908665 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f2e2d7-51f2-4ea5-9b28-f3a63ff3e1fd None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:26.919120 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 299/605] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 23 00:43:26 2022] GET /identity/v3/role_assignments?user.id=f183fd83a96a4af0bc9df03e6f61ca4a&scope.project.id=60f8594760e44ce3888a32702ea9afcc&role.id=832e4b25a75c4d30a010d6803a5a4577 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:26.920322 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2e2d7-51f2-4ea5-9b28-f3a63ff3e1fd None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:27.044095 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe891e7-0e22-4e98-a779-2057ce3f8920 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:27.062496 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2e2d7-51f2-4ea5-9b28-f3a63ff3e1fd None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:27.100225 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d833ff8-e83e-427e-8383-ba2e1fcfa62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:27.100763 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d833ff8-e83e-427e-8383-ba2e1fcfa62f None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:27.101049 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d833ff8-e83e-427e-8383-ba2e1fcfa62f None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:27.101329 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d833ff8-e83e-427e-8383-ba2e1fcfa62f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:27.102457 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d833ff8-e83e-427e-8383-ba2e1fcfa62f None admin] RBAC: Adding query filter params (interface=public, service_id=9d8f01bb59d349059283488f4eb75504, region_id=RegionOne) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:27.102572 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d833ff8-e83e-427e-8383-ba2e1fcfa62f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:27.104003 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d833ff8-e83e-427e-8383-ba2e1fcfa62f None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:27.110208 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 300/606] 10.222.0.23 () {56 vars in 1251 bytes} [Sun Oct 23 00:43:26 2022] GET /identity/v3/endpoints?service_id=9d8f01bb59d349059283488f4eb75504&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:27.115983 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d833ff8-e83e-427e-8383-ba2e1fcfa62f None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:27.124673 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:27.137384 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9d8b2-76b6-464d-bd2a-ddd95c77eac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:27.138230 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9d8b2-76b6-464d-bd2a-ddd95c77eac9 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:27.138656 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9d8b2-76b6-464d-bd2a-ddd95c77eac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:27.139024 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9d8b2-76b6-464d-bd2a-ddd95c77eac9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:27.154386 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f9d8b2-76b6-464d-bd2a-ddd95c77eac9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:27.154567 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:27.156622 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f9d8b2-76b6-464d-bd2a-ddd95c77eac9 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:27.180080 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-28f9d8b2-76b6-464d-bd2a-ddd95c77eac9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:27.180080 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:27.180080 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:27.180080 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:27.180080 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:27.180080 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:27.180080 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:27.180080 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:27.180080 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:27.180080 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:27.180080 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:27.180080 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:27.180080 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:43:27.180080 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:43:27.180080 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:43:27.180080 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:43:27.181190 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:27.181190 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:27.181190 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:27.181190 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:27.181190 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:27.181190 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:27.181190 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:27.181190 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:27.181190 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:27.181190 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:27.181190 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:27.181190 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:27.181190 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:27.181190 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:27.181190 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:27.181190 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:27.181190 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:43:27.182120 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:43:27.182120 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:27.182120 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:27.182120 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 307/607] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:43:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:27.190995 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9d8b2-76b6-464d-bd2a-ddd95c77eac9 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:27.234643 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d833ff8-e83e-427e-8383-ba2e1fcfa62f None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:27.273298 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c67f2-2770-457a-a177-37458bc167c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:27.274017 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c67f2-2770-457a-a177-37458bc167c7 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:27.275127 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c67f2-2770-457a-a177-37458bc167c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:27.275476 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c67f2-2770-457a-a177-37458bc167c7 None admin] PATH_INFO: `/v3/services` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:27.276179 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c67f2-2770-457a-a177-37458bc167c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:27.277751 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c67f2-2770-457a-a177-37458bc167c7 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:27.283208 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 301/608] 10.222.0.23 () {56 vars in 1087 bytes} [Sun Oct 23 00:43:27 2022] GET /identity/v3/services => generated 772 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:43:27.321738 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9d8b2-76b6-464d-bd2a-ddd95c77eac9 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:27.374814 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1057dc4-ac8a-444b-a79a-611255b6f3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:27.375767 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1057dc4-ac8a-444b-a79a-611255b6f3c0 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:27.376235 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1057dc4-ac8a-444b-a79a-611255b6f3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:27.376717 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1057dc4-ac8a-444b-a79a-611255b6f3c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:27.377573 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1057dc4-ac8a-444b-a79a-611255b6f3c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:27.378098 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1057dc4-ac8a-444b-a79a-611255b6f3c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:27.380284 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1057dc4-ac8a-444b-a79a-611255b6f3c0 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:27.401327 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 308/609] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:27.407444 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c67f2-2770-457a-a177-37458bc167c7 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:27.535889 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:27.541712 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c67f2-2770-457a-a177-37458bc167c7 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:27.577592 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10da9cc-9642-4509-9846-2d650f505d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:27.578269 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10da9cc-9642-4509-9846-2d650f505d16 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:27.578601 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10da9cc-9642-4509-9846-2d650f505d16 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:27.578883 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10da9cc-9642-4509-9846-2d650f505d16 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:27.586866 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10da9cc-9642-4509-9846-2d650f505d16 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:27.588328 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10da9cc-9642-4509-9846-2d650f505d16 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:27.599912 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-a10da9cc-9642-4509-9846-2d650f505d16 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 23 00:43:27.599912 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:27.599912 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:27.599912 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:27.599912 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:27.599912 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:27.599912 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:27.599912 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:27.599912 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:27.599912 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:27.599912 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:27.599912 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:27.599912 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 00:43:27.599912 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 00:43:27.599912 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 00:43:27.599912 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 00:43:27.600885 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:27.600885 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:27.600885 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:43:27.600885 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:43:27.600885 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:43:27.600885 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:43:27.600885 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:27.600885 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:27.600885 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:27.600885 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:27.600885 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:27.600885 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:27.600885 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:27.600885 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:27.600885 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:27.600885 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:27.600885 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:27.600885 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:27.601799 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:27.601799 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:27.601799 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 00:43:27.601799 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 00:43:27.601799 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 00:43:27.601799 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 00:43:27.601799 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 00:43:27.601799 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 00:43:27.601799 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 23 00:43:27.601799 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:27.601799 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 302/610] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 23 00:43:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:27.607410 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1057dc4-ac8a-444b-a79a-611255b6f3c0 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:27.655485 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:27.733399 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1057dc4-ac8a-444b-a79a-611255b6f3c0 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:27.797815 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c56951-7454-42df-969a-67385a8c3735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:27.798827 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c56951-7454-42df-969a-67385a8c3735 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:27.799315 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c56951-7454-42df-969a-67385a8c3735 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:27.799815 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c56951-7454-42df-969a-67385a8c3735 None admin] PATH_INFO: `/v3/users` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:27.800747 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c56951-7454-42df-969a-67385a8c3735 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:27.801311 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c56951-7454-42df-969a-67385a8c3735 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:27.803468 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c56951-7454-42df-969a-67385a8c3735 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:27.826343 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 309/611] 10.222.0.23 () {56 vars in 1135 bytes} [Sun Oct 23 00:43:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:27.832086 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10da9cc-9642-4509-9846-2d650f505d16 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:27.941630 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10da9cc-9642-4509-9846-2d650f505d16 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:27.976018 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93389f-7f35-47d9-bd76-0a5bfd6c39da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:27.976630 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93389f-7f35-47d9-bd76-0a5bfd6c39da None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:27.976913 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93389f-7f35-47d9-bd76-0a5bfd6c39da None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:27.977189 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93389f-7f35-47d9-bd76-0a5bfd6c39da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:28.023507 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:28.039404 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70113003-5089-4248-b1b5-37ffc5f75ca2 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:28.039750 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70113003-5089-4248-b1b5-37ffc5f75ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:28.040288 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70113003-5089-4248-b1b5-37ffc5f75ca2 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:28.042415 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 310/612] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:43:28.050301 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885cf808-7433-42ec-b362-9c5e6cfc509d None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:28.050602 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885cf808-7433-42ec-b362-9c5e6cfc509d None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:28.050881 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885cf808-7433-42ec-b362-9c5e6cfc509d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:28.056122 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d93389f-7f35-47d9-bd76-0a5bfd6c39da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:28.057582 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d93389f-7f35-47d9-bd76-0a5bfd6c39da None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:28.071689 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-885cf808-7433-42ec-b362-9c5e6cfc509d None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:28.072902 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-885cf808-7433-42ec-b362-9c5e6cfc509d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:28.157715 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 311/613] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:43:28.245610 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae83d33-6588-4cd5-af93-f8efa388c53d None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:28.245610 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae83d33-6588-4cd5-af93-f8efa388c53d None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:28.245610 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae83d33-6588-4cd5-af93-f8efa388c53d None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:28.246918 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 312/614] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:43:28.252310 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9aa9c7-9fd5-42dd-98a7-461bdff5097e None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:28.252708 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9aa9c7-9fd5-42dd-98a7-461bdff5097e None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:28.252993 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9aa9c7-9fd5-42dd-98a7-461bdff5097e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:28.266800 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 303/615] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 23 00:43:27 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 23 00:43:28.272821 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93389f-7f35-47d9-bd76-0a5bfd6c39da None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:28.281722 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-cb9aa9c7-9fd5-42dd-98a7-461bdff5097e None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:28.283336 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-cb9aa9c7-9fd5-42dd-98a7-461bdff5097e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:28.326462 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:28.372665 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:28.417971 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 313/616] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 00:43:28.433015 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93389f-7f35-47d9-bd76-0a5bfd6c39da None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:28.468630 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db02be-ebdd-4846-b7b0-e3a73c958f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:28.469343 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db02be-ebdd-4846-b7b0-e3a73c958f9b None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:28.469624 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db02be-ebdd-4846-b7b0-e3a73c958f9b None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:28.469891 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db02be-ebdd-4846-b7b0-e3a73c958f9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:28.481747 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78db02be-ebdd-4846-b7b0-e3a73c958f9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:28.483331 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78db02be-ebdd-4846-b7b0-e3a73c958f9b None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:28.499858 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-78db02be-ebdd-4846-b7b0-e3a73c958f9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:28.499858 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:28.499858 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:28.499858 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:28.499858 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:28.499858 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:28.499858 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:28.499858 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:28.499858 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:28.499858 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:28.499858 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:28.499858 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:28.499858 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:43:28.499858 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:43:28.499858 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:43:28.499858 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:43:28.500940 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:28.500940 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:28.500940 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:28.500940 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:28.500940 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:28.500940 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:28.500940 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:28.500940 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:28.500940 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:28.500940 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:28.500940 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:28.500940 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:28.500940 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:28.500940 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:28.500940 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:28.500940 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:28.500940 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:43:28.501902 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:43:28.501902 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:28.501902 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:28.501902 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 304/617] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:43:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:28.507605 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9aa9c7-9fd5-42dd-98a7-461bdff5097e None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:28.510107 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db02be-ebdd-4846-b7b0-e3a73c958f9b None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:28.618898 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9aa9c7-9fd5-42dd-98a7-461bdff5097e None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:28.685725 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a9437e-942b-4c17-a6e9-f7ac269da574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:28.686524 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9437e-942b-4c17-a6e9-f7ac269da574 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:28.686779 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9437e-942b-4c17-a6e9-f7ac269da574 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:28.687047 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9437e-942b-4c17-a6e9-f7ac269da574 None admin] PATH_INFO: `/v3/domains` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:28.687687 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a9437e-942b-4c17-a6e9-f7ac269da574 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:28.687985 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a9437e-942b-4c17-a6e9-f7ac269da574 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:28.689353 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a9437e-942b-4c17-a6e9-f7ac269da574 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:28.705772 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db02be-ebdd-4846-b7b0-e3a73c958f9b None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:28.717791 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 314/618] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:28.722444 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:28.723590 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a9437e-942b-4c17-a6e9-f7ac269da574 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:28.759706 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:28.775071 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faddd5d8-5d1a-49f8-8760-ff27dade21df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:28.775703 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddd5d8-5d1a-49f8-8760-ff27dade21df None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:28.775977 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddd5d8-5d1a-49f8-8760-ff27dade21df None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:28.776244 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddd5d8-5d1a-49f8-8760-ff27dade21df None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:28.776825 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faddd5d8-5d1a-49f8-8760-ff27dade21df None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:28.778227 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faddd5d8-5d1a-49f8-8760-ff27dade21df None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:28.791317 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-faddd5d8-5d1a-49f8-8760-ff27dade21df None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 23 00:43:28.791317 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:28.791317 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:43:28.791317 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:43:28.791317 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:43:28.791317 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:43:28.791317 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:43:28.791317 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:43:28.791317 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 23 00:43:28.791317 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:28.791317 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:43:28.791317 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:28.791317 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:28.791317 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:28.791317 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:28.791317 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:28.791317 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:28.792446 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:28.792446 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:28.792446 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:28.792446 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:28.792446 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:28.792446 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:28.792446 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:43:28.792446 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:43:28.792446 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:43:28.792446 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:43:28.792446 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:28.792446 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:28.792446 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:28.792446 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:28.792446 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:28.792446 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:28.793307 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:28.793307 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:28.793307 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:28.793307 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:28.793307 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:28.793307 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:28.793307 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:28.793307 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:28.793307 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:28.793307 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:28.793307 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:43:28.793307 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:43:28.793307 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 23 00:43:28.793307 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:28.793307 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 305/619] 10.222.0.23 () {56 vars in 1129 bytes} [Sun Oct 23 00:43:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:28.800298 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faddd5d8-5d1a-49f8-8760-ff27dade21df None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:28.850167 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a9437e-942b-4c17-a6e9-f7ac269da574 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:28.887784 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde21d40-fe74-4603-ba1b-050792cf5a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:28.888700 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde21d40-fe74-4603-ba1b-050792cf5a82 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:28.888982 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde21d40-fe74-4603-ba1b-050792cf5a82 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:28.889259 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde21d40-fe74-4603-ba1b-050792cf5a82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:28.898707 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde21d40-fe74-4603-ba1b-050792cf5a82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:28.900552 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde21d40-fe74-4603-ba1b-050792cf5a82 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:28.909961 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faddd5d8-5d1a-49f8-8760-ff27dade21df None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:28.917166 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-fde21d40-fe74-4603-ba1b-050792cf5a82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:43:28.917166 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:28.917166 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:28.917166 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:28.917166 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:28.917166 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:28.917166 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:28.917166 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:28.917166 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:28.917166 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:28.917166 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:28.917166 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:28.917166 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 00:43:28.917166 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 00:43:28.917166 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 00:43:28.918153 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 00:43:28.918153 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:28.918153 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:28.918153 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:28.918153 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:28.918153 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:28.918153 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:28.918153 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:28.918153 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:28.918153 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:28.918153 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:28.918153 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:28.918153 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:28.918153 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:28.918153 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:28.918153 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:28.918153 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:28.919080 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 00:43:28.919080 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 00:43:28.919080 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 00:43:28.919080 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 00:43:28.919080 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 00:43:28.919080 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 00:43:28.919080 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:43:28.919080 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:28.919530 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 315/620] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 23 00:43:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:28.920059 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde21d40-fe74-4603-ba1b-050792cf5a82 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:28.948065 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913979e-9ba2-4abb-b7f2-33aaf27134d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:28.948729 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913979e-9ba2-4abb-b7f2-33aaf27134d5 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:28.949012 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913979e-9ba2-4abb-b7f2-33aaf27134d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:28.949281 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913979e-9ba2-4abb-b7f2-33aaf27134d5 None admin] PATH_INFO: `/v3/services` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:28.950015 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913979e-9ba2-4abb-b7f2-33aaf27134d5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:28.950342 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913979e-9ba2-4abb-b7f2-33aaf27134d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:28.951951 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913979e-9ba2-4abb-b7f2-33aaf27134d5 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:28.957279 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 306/621] 10.222.0.23 () {56 vars in 1124 bytes} [Sun Oct 23 00:43:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:43:28.958104 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913979e-9ba2-4abb-b7f2-33aaf27134d5 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:28.997197 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:29.021483 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:29.044225 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde21d40-fe74-4603-ba1b-050792cf5a82 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:29.073930 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913979e-9ba2-4abb-b7f2-33aaf27134d5 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:29.080658 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a35e8-ba3e-423f-aa9f-3bab89e8cbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:29.081279 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a35e8-ba3e-423f-aa9f-3bab89e8cbb2 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:29.081556 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a35e8-ba3e-423f-aa9f-3bab89e8cbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:29.081824 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a35e8-ba3e-423f-aa9f-3bab89e8cbb2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:29.082566 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a35e8-ba3e-423f-aa9f-3bab89e8cbb2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:29.084035 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a35e8-ba3e-423f-aa9f-3bab89e8cbb2 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:29.094965 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-786a35e8-ba3e-423f-aa9f-3bab89e8cbb2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 23 00:43:29.094965 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:29.094965 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:43:29.094965 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:43:29.094965 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:43:29.094965 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:43:29.094965 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:43:29.094965 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:43:29.094965 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 23 00:43:29.094965 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:29.094965 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:43:29.094965 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:29.094965 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:29.094965 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:29.094965 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:29.094965 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:29.096959 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:29.096959 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:29.096959 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:29.096959 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:29.096959 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:29.096959 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:29.096959 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:29.096959 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:43:29.096959 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:43:29.096959 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:43:29.096959 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:43:29.096959 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:29.096959 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:29.096959 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:29.096959 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:29.096959 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:29.096959 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:29.098910 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:29.098910 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:29.098910 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:29.098910 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:29.098910 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:29.098910 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:29.098910 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:29.098910 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:29.098910 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:29.098910 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:29.098910 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:43:29.098910 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:43:29.098910 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 23 00:43:29.098910 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:29.098910 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 316/622] 10.222.0.23 () {56 vars in 1132 bytes} [Sun Oct 23 00:43:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:29.100566 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a35e8-ba3e-423f-aa9f-3bab89e8cbb2 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:29.115144 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7f514-1b65-4d9c-9900-c6a87ca6cfa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:29.116120 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7f514-1b65-4d9c-9900-c6a87ca6cfa8 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:29.116469 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7f514-1b65-4d9c-9900-c6a87ca6cfa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:29.116815 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7f514-1b65-4d9c-9900-c6a87ca6cfa8 None admin] PATH_INFO: `/v3/projects` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:29.117686 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7f514-1b65-4d9c-9900-c6a87ca6cfa8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:29.118191 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7f514-1b65-4d9c-9900-c6a87ca6cfa8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:29.119613 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7f514-1b65-4d9c-9900-c6a87ca6cfa8 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:29.135379 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 307/623] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 23 00:43:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:29.136380 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7f514-1b65-4d9c-9900-c6a87ca6cfa8 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:29.222837 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a35e8-ba3e-423f-aa9f-3bab89e8cbb2 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:29.267771 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:29.271049 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58742e2-8e43-410f-8247-025b3db6be80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:29.271945 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58742e2-8e43-410f-8247-025b3db6be80 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:29.272385 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58742e2-8e43-410f-8247-025b3db6be80 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:29.272813 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58742e2-8e43-410f-8247-025b3db6be80 None admin] PATH_INFO: `/v3/services` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:29.273610 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58742e2-8e43-410f-8247-025b3db6be80 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:29.273727 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7f514-1b65-4d9c-9900-c6a87ca6cfa8 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:29.274202 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58742e2-8e43-410f-8247-025b3db6be80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:29.276647 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58742e2-8e43-410f-8247-025b3db6be80 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:29.286231 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 317/624] 10.222.0.23 () {56 vars in 1124 bytes} [Sun Oct 23 00:43:29 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:29.287460 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58742e2-8e43-410f-8247-025b3db6be80 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:29.298546 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:29.312917 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda81af-c983-4360-a633-9c1f6dac1d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:29.313908 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda81af-c983-4360-a633-9c1f6dac1d8a None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:29.314430 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda81af-c983-4360-a633-9c1f6dac1d8a None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:29.314941 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda81af-c983-4360-a633-9c1f6dac1d8a None admin] PATH_INFO: `/v3/services` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:29.315788 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fda81af-c983-4360-a633-9c1f6dac1d8a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:29.316357 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fda81af-c983-4360-a633-9c1f6dac1d8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:29.318023 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fda81af-c983-4360-a633-9c1f6dac1d8a None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:29.323923 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 308/625] 10.222.0.23 () {56 vars in 1126 bytes} [Sun Oct 23 00:43:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:29.325055 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda81af-c983-4360-a633-9c1f6dac1d8a None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:29.418241 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58742e2-8e43-410f-8247-025b3db6be80 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:29.439396 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda81af-c983-4360-a633-9c1f6dac1d8a None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:29.464581 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618a831-ec76-435c-8c5f-7f28fae21d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:29.465208 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618a831-ec76-435c-8c5f-7f28fae21d96 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:29.465493 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618a831-ec76-435c-8c5f-7f28fae21d96 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:29.465771 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618a831-ec76-435c-8c5f-7f28fae21d96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:29.466819 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d618a831-ec76-435c-8c5f-7f28fae21d96 None admin] RBAC: Adding query filter params (role.id=1e2073be75174689aa4fac29e674583d, scope.project.id=60f8594760e44ce3888a32702ea9afcc, user.id=84a0345be05644e3a7a71c5a2bf21c41) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:29.467131 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d618a831-ec76-435c-8c5f-7f28fae21d96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:29.469247 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d618a831-ec76-435c-8c5f-7f28fae21d96 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:29.477763 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 318/626] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 23 00:43:29 2022] GET /identity/v3/role_assignments?user.id=84a0345be05644e3a7a71c5a2bf21c41&scope.project.id=60f8594760e44ce3888a32702ea9afcc&role.id=1e2073be75174689aa4fac29e674583d => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:29.479471 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618a831-ec76-435c-8c5f-7f28fae21d96 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:29.489791 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeae284-3b90-4e53-a0da-78653a5f174a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:29.490892 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeae284-3b90-4e53-a0da-78653a5f174a None admin] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:29.492422 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeae284-3b90-4e53-a0da-78653a5f174a None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:29.494674 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeae284-3b90-4e53-a0da-78653a5f174a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:29.497986 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeae284-3b90-4e53-a0da-78653a5f174a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:29.503478 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeae284-3b90-4e53-a0da-78653a5f174a None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:29.547554 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 309/627] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 23 00:43:29 2022] POST /identity/v3/endpoints => generated 346 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:43:29.596366 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:29.641316 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618a831-ec76-435c-8c5f-7f28fae21d96 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:29.707253 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c915e7-5e1e-472c-81fa-5d1568ffb0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:29.708459 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c915e7-5e1e-472c-81fa-5d1568ffb0cc None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:29.708716 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c915e7-5e1e-472c-81fa-5d1568ffb0cc None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:29.708895 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c915e7-5e1e-472c-81fa-5d1568ffb0cc None admin] PATH_INFO: `/v3/services` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:29.709578 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c915e7-5e1e-472c-81fa-5d1568ffb0cc None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:29.709886 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c915e7-5e1e-472c-81fa-5d1568ffb0cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:29.711491 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c915e7-5e1e-472c-81fa-5d1568ffb0cc None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:29.718796 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 319/628] 10.222.0.23 () {56 vars in 1126 bytes} [Sun Oct 23 00:43:29 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:29.847906 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed693e-a973-4089-b822-eb39b87e7b31 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:29.848970 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed693e-a973-4089-b822-eb39b87e7b31 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:29.848970 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed693e-a973-4089-b822-eb39b87e7b31 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:29.850611 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 310/629] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:43:29.855604 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a8cd6-6639-406e-9f2d-7c10cce9a283 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:29.855889 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a8cd6-6639-406e-9f2d-7c10cce9a283 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:29.856420 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a8cd6-6639-406e-9f2d-7c10cce9a283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:29.876817 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-df2a8cd6-6639-406e-9f2d-7c10cce9a283 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:29.878090 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-df2a8cd6-6639-406e-9f2d-7c10cce9a283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:29.958685 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 320/630] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:43:30.022050 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a915f2-58e8-476a-9d47-e7629576f081 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:30.022403 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a915f2-58e8-476a-9d47-e7629576f081 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:30.022627 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a915f2-58e8-476a-9d47-e7629576f081 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:30.024101 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 311/631] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:43:30.029699 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e851746-d4d7-4aa0-ac71-9e61d87f73a9 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:30.029992 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e851746-d4d7-4aa0-ac71-9e61d87f73a9 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:30.030358 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e851746-d4d7-4aa0-ac71-9e61d87f73a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:30.050900 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-1e851746-d4d7-4aa0-ac71-9e61d87f73a9 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:30.052485 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-1e851746-d4d7-4aa0-ac71-9e61d87f73a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:30.124253 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:30.134358 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 321/632] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:43:30.263374 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a915f2-58e8-476a-9d47-e7629576f081 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:30.286031 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:30.388830 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a915f2-58e8-476a-9d47-e7629576f081 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:30.431502 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d774a17-814c-4e90-8a10-ef4a6f4b799f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:30.432135 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d774a17-814c-4e90-8a10-ef4a6f4b799f None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:30.432415 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d774a17-814c-4e90-8a10-ef4a6f4b799f None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:30.432686 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d774a17-814c-4e90-8a10-ef4a6f4b799f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:30.447434 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d774a17-814c-4e90-8a10-ef4a6f4b799f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:43:30.452267 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-8d774a17-814c-4e90-8a10-ef4a6f4b799f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 23 00:43:30.452267 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:30.452267 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:30.452267 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:30.452267 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:30.452267 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:30.452267 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:30.452267 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:30.452267 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:30.452267 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:30.452267 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:30.452267 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:30.452267 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:43:30.452267 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:43:30.452267 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:43:30.452267 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:43:30.453210 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:43:30.453210 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:43:30.453210 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:43:30.453210 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:43:30.453210 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:30.453210 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:30.453210 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:30.453210 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:30.453210 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:30.453210 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:30.453210 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:30.453210 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:30.453210 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:30.453210 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:30.453210 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:30.453210 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:30.454048 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:30.454048 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:30.454048 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:30.454048 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:30.454048 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:43:30.454048 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:43:30.454048 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:43:30.454048 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:43:30.454048 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:43:30.454048 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:43:30.454048 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 23 00:43:30.454048 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:30.454048 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 312/633] 10.222.0.23 () {56 vars in 1120 bytes} [Sun Oct 23 00:43:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:43:30.459270 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e851746-d4d7-4aa0-ac71-9e61d87f73a9 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:30.583254 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d774a17-814c-4e90-8a10-ef4a6f4b799f None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:30.591843 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e851746-d4d7-4aa0-ac71-9e61d87f73a9 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:30.655412 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21749a76-7e8c-4800-8c79-9f29b5df16ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:30.655953 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21749a76-7e8c-4800-8c79-9f29b5df16ee None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:30.656234 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21749a76-7e8c-4800-8c79-9f29b5df16ee None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:30.656503 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21749a76-7e8c-4800-8c79-9f29b5df16ee None admin] PATH_INFO: `/v3/roles` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:30.657184 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21749a76-7e8c-4800-8c79-9f29b5df16ee None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:30.657484 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21749a76-7e8c-4800-8c79-9f29b5df16ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:30.658938 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21749a76-7e8c-4800-8c79-9f29b5df16ee None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:30.678156 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 322/634] 10.222.0.23 () {56 vars in 1115 bytes} [Sun Oct 23 00:43:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:30.683697 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21749a76-7e8c-4800-8c79-9f29b5df16ee None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:30.709158 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:30.750050 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d774a17-814c-4e90-8a10-ef4a6f4b799f None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:30.784654 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:30.821313 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5953ca-80c5-4b1e-b22c-50338ad1c9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:30.821948 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5953ca-80c5-4b1e-b22c-50338ad1c9a3 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:30.822249 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5953ca-80c5-4b1e-b22c-50338ad1c9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:30.822520 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5953ca-80c5-4b1e-b22c-50338ad1c9a3 None admin] PATH_INFO: `/v3/services/network` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:30.823105 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5953ca-80c5-4b1e-b22c-50338ad1c9a3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:30.824539 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5953ca-80c5-4b1e-b22c-50338ad1c9a3 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:30.836943 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-cb5953ca-80c5-4b1e-b22c-50338ad1c9a3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 23 00:43:30.836943 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:30.836943 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:43:30.836943 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:43:30.836943 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:43:30.836943 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:43:30.836943 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:43:30.836943 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:43:30.836943 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 23 00:43:30.836943 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:30.836943 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:43:30.836943 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:30.836943 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:30.836943 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:30.836943 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:30.836943 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:30.836943 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:30.837900 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:30.837900 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:30.837900 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:30.837900 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:30.837900 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:30.837900 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:30.837900 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:43:30.837900 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:43:30.837900 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:43:30.837900 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:43:30.837900 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:30.837900 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:30.837900 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:30.837900 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:30.837900 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:30.837900 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:30.838784 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:30.838784 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:30.838784 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:30.838784 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:30.838784 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:30.838784 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:30.838784 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:30.838784 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:30.838784 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:30.838784 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:30.838784 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:43:30.838784 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:43:30.838784 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 23 00:43:30.838784 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:30.838784 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 313/635] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 23 00:43:30 2022] GET /identity/v3/services/network => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:43:30.849489 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5953ca-80c5-4b1e-b22c-50338ad1c9a3 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:30.890640 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21749a76-7e8c-4800-8c79-9f29b5df16ee None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:30.966209 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5953ca-80c5-4b1e-b22c-50338ad1c9a3 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:30.993888 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6655f9a9-1c2a-4cdb-a919-eeca1c1dfaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:30.994557 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655f9a9-1c2a-4cdb-a919-eeca1c1dfaa3 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:30.994841 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655f9a9-1c2a-4cdb-a919-eeca1c1dfaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:30.995114 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655f9a9-1c2a-4cdb-a919-eeca1c1dfaa3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:31.011933 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2492fa3f-4683-4616-b5fa-400b4da62c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:31.014585 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492fa3f-4683-4616-b5fa-400b4da62c2c None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:31.015077 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492fa3f-4683-4616-b5fa-400b4da62c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:31.015773 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492fa3f-4683-4616-b5fa-400b4da62c2c None admin] PATH_INFO: `/v3/services` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:31.017930 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2492fa3f-4683-4616-b5fa-400b4da62c2c None admin] RBAC: Adding query filter params (name=network) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:31.018478 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2492fa3f-4683-4616-b5fa-400b4da62c2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:31.019611 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6655f9a9-1c2a-4cdb-a919-eeca1c1dfaa3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:31.022207 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6655f9a9-1c2a-4cdb-a919-eeca1c1dfaa3 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:31.023049 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2492fa3f-4683-4616-b5fa-400b4da62c2c None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:31.030296 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 314/636] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Oct 23 00:43:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:31.036339 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2492fa3f-4683-4616-b5fa-400b4da62c2c None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:31.042758 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:31.056252 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-6655f9a9-1c2a-4cdb-a919-eeca1c1dfaa3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:31.056252 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:31.056252 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:31.056252 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:31.056252 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:31.056252 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:31.056252 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:31.056252 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:31.056252 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:31.056252 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:31.056252 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:31.056252 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:31.056252 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:43:31.056252 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:43:31.056252 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:43:31.056252 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:43:31.057215 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:31.057215 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:31.057215 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:31.057215 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:31.057215 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:31.057215 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:31.057215 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:31.057215 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:31.057215 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:31.057215 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:31.057215 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:31.057215 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:31.057215 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:31.057215 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:31.057215 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:31.057215 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:31.057215 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:43:31.058121 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:43:31.058121 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:31.058121 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:31.061540 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 323/637] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:43:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:31.065880 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6655f9a9-1c2a-4cdb-a919-eeca1c1dfaa3 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:31.230839 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2492fa3f-4683-4616-b5fa-400b4da62c2c None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:31.270985 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf19e8-7e9f-46ae-b100-92f5c1d9161f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:31.272601 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf19e8-7e9f-46ae-b100-92f5c1d9161f None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:31.273153 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf19e8-7e9f-46ae-b100-92f5c1d9161f None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:31.273629 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf19e8-7e9f-46ae-b100-92f5c1d9161f None admin] PATH_INFO: `/v3/services` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:31.274488 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf19e8-7e9f-46ae-b100-92f5c1d9161f None admin] RBAC: Adding query filter params (type=network) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:31.275020 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf19e8-7e9f-46ae-b100-92f5c1d9161f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:31.276847 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf19e8-7e9f-46ae-b100-92f5c1d9161f None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:31.280267 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6655f9a9-1c2a-4cdb-a919-eeca1c1dfaa3 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:31.283017 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 315/638] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Oct 23 00:43:31 2022] GET /identity/v3/services?type=network => generated 350 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:31.284802 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:31.297261 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf19e8-7e9f-46ae-b100-92f5c1d9161f None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:31.344411 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60018d59-f90b-4b5d-851d-36c106f9eb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:31.345038 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60018d59-f90b-4b5d-851d-36c106f9eb9b None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:31.345302 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60018d59-f90b-4b5d-851d-36c106f9eb9b None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:31.345576 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60018d59-f90b-4b5d-851d-36c106f9eb9b None admin] PATH_INFO: `/v3/domains` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:31.346286 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60018d59-f90b-4b5d-851d-36c106f9eb9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:31.346596 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60018d59-f90b-4b5d-851d-36c106f9eb9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:31.348053 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60018d59-f90b-4b5d-851d-36c106f9eb9b None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:31.372491 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 324/639] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:31.376025 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60018d59-f90b-4b5d-851d-36c106f9eb9b None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:31.416797 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:31.472220 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf19e8-7e9f-46ae-b100-92f5c1d9161f None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:31.538541 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3944f0c-fcd9-4eb4-818a-adbbd39ccd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:31.539127 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3944f0c-fcd9-4eb4-818a-adbbd39ccd84 None admin] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:31.539411 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3944f0c-fcd9-4eb4-818a-adbbd39ccd84 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:31.539682 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3944f0c-fcd9-4eb4-818a-adbbd39ccd84 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:31.540355 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3944f0c-fcd9-4eb4-818a-adbbd39ccd84 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:31.541719 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3944f0c-fcd9-4eb4-818a-adbbd39ccd84 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:31.553742 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60018d59-f90b-4b5d-851d-36c106f9eb9b None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:31.582510 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 316/640] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 23 00:43:31 2022] POST /identity/v3/endpoints => generated 337 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:43:31.613207 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d929d09-12a7-45f7-8f9a-b71d705d103d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:31.613883 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d929d09-12a7-45f7-8f9a-b71d705d103d None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:31.614336 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d929d09-12a7-45f7-8f9a-b71d705d103d None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:31.614551 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d929d09-12a7-45f7-8f9a-b71d705d103d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:31.623134 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d929d09-12a7-45f7-8f9a-b71d705d103d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:31.624634 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d929d09-12a7-45f7-8f9a-b71d705d103d None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:31.639141 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-6d929d09-12a7-45f7-8f9a-b71d705d103d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 23 00:43:31.639141 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:31.639141 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:31.639141 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:31.639141 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:31.639141 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:31.639141 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:31.639141 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:31.639141 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:31.639141 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:31.639141 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:31.639141 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:31.639141 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 00:43:31.639141 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 00:43:31.639141 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 00:43:31.639141 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 00:43:31.640150 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:31.640150 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:31.640150 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:43:31.640150 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:43:31.640150 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:43:31.640150 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:43:31.640150 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:31.640150 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:31.640150 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:31.640150 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:31.640150 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:31.640150 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:31.640150 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:31.640150 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:31.640150 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:31.640150 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:31.640150 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:31.640150 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:31.641100 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:31.641100 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:31.641100 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 00:43:31.641100 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 00:43:31.641100 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 00:43:31.641100 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 00:43:31.641100 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 00:43:31.641100 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 00:43:31.641100 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 23 00:43:31.641100 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:31.641100 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 325/641] 10.222.0.23 () {56 vars in 1117 bytes} [Sun Oct 23 00:43:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:31.646948 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3944f0c-fcd9-4eb4-818a-adbbd39ccd84 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:31.786659 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3944f0c-fcd9-4eb4-818a-adbbd39ccd84 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:31.814358 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:31.826596 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e28650-668a-4a69-8ede-f987bc143af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:31.827208 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e28650-668a-4a69-8ede-f987bc143af9 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:31.827490 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e28650-668a-4a69-8ede-f987bc143af9 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:31.827765 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e28650-668a-4a69-8ede-f987bc143af9 None admin] PATH_INFO: `/v3/users` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:31.828510 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e28650-668a-4a69-8ede-f987bc143af9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:31.830001 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e28650-668a-4a69-8ede-f987bc143af9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:31.831505 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e28650-668a-4a69-8ede-f987bc143af9 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:31.855678 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 317/642] 10.222.0.23 () {56 vars in 1149 bytes} [Sun Oct 23 00:43:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:31.861617 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d929d09-12a7-45f7-8f9a-b71d705d103d None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:31.887087 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:31.981893 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d929d09-12a7-45f7-8f9a-b71d705d103d None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:32.022069 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7887630-362b-4429-a2cd-0e620ae60486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:32.022836 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7887630-362b-4429-a2cd-0e620ae60486 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:32.023121 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7887630-362b-4429-a2cd-0e620ae60486 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:32.023393 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7887630-362b-4429-a2cd-0e620ae60486 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:32.037643 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7887630-362b-4429-a2cd-0e620ae60486 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:32.039265 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7887630-362b-4429-a2cd-0e620ae60486 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:32.058334 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-e7887630-362b-4429-a2cd-0e620ae60486 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:32.058334 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:32.058334 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:32.058334 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:32.058334 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:32.058334 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:32.058334 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:32.058334 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:32.058334 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:32.058334 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:32.058334 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:32.058334 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:32.058334 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:43:32.058334 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:43:32.058334 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:43:32.058334 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:43:32.059336 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:32.059336 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:32.059336 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:32.059336 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:32.059336 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:32.059336 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:32.059336 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:32.059336 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:32.059336 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:32.059336 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:32.059336 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:32.059336 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:32.059336 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:32.059336 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:32.059336 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:32.059336 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:32.059336 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:43:32.060215 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:43:32.060215 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:32.060215 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:32.060215 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 326/643] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:43:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:32.065233 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e28650-668a-4a69-8ede-f987bc143af9 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:32.168298 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f8c11-a3e3-442b-ac89-edcaf428cb46 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:32.168664 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f8c11-a3e3-442b-ac89-edcaf428cb46 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:32.168824 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f8c11-a3e3-442b-ac89-edcaf428cb46 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:32.170478 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 327/644] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:43:32.175927 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550eb29a-bb17-43ad-8d2e-a45d4d641648 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:32.176738 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550eb29a-bb17-43ad-8d2e-a45d4d641648 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:32.177015 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550eb29a-bb17-43ad-8d2e-a45d4d641648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:32.186403 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e28650-668a-4a69-8ede-f987bc143af9 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:32.196815 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-550eb29a-bb17-43ad-8d2e-a45d4d641648 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:32.198253 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-550eb29a-bb17-43ad-8d2e-a45d4d641648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:32.223482 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b5768-c297-44cb-b5be-31fdd668e1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:32.224086 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b5768-c297-44cb-b5be-31fdd668e1ff None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:32.224361 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b5768-c297-44cb-b5be-31fdd668e1ff None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:32.224630 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b5768-c297-44cb-b5be-31fdd668e1ff None admin] PATH_INFO: `/v3/domains` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:32.225269 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b5768-c297-44cb-b5be-31fdd668e1ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:32.225569 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b5768-c297-44cb-b5be-31fdd668e1ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:32.226970 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b5768-c297-44cb-b5be-31fdd668e1ff None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:32.239239 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 318/645] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:32.240503 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31291aef-dcc3-424a-81ce-4fc47fe7f599 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:32.240791 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31291aef-dcc3-424a-81ce-4fc47fe7f599 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:32.241063 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31291aef-dcc3-424a-81ce-4fc47fe7f599 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:32.246123 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 319/646] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:43:32.246123 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31291aef-dcc3-424a-81ce-4fc47fe7f599 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:32.283073 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 328/647] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:32 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 00:43:32.284557 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79176ea6-2527-4239-809c-528be5b38e68 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:32.284848 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79176ea6-2527-4239-809c-528be5b38e68 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:32.285126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79176ea6-2527-4239-809c-528be5b38e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:32.291484 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:32.304063 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:32.307178 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-79176ea6-2527-4239-809c-528be5b38e68 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:32.308371 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-79176ea6-2527-4239-809c-528be5b38e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:32.378040 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31291aef-dcc3-424a-81ce-4fc47fe7f599 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:32.402239 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 329/648] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:32 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:43:32.421483 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12134ded-288d-4f1f-9cd3-7557fd7c8d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:32.422167 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12134ded-288d-4f1f-9cd3-7557fd7c8d2a None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:32.422454 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12134ded-288d-4f1f-9cd3-7557fd7c8d2a None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:32.422726 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12134ded-288d-4f1f-9cd3-7557fd7c8d2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:32.430610 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12134ded-288d-4f1f-9cd3-7557fd7c8d2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:32.432098 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12134ded-288d-4f1f-9cd3-7557fd7c8d2a None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:32.443760 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-12134ded-288d-4f1f-9cd3-7557fd7c8d2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:43:32.443760 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:32.443760 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:32.443760 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:32.443760 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:32.443760 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:32.443760 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:32.443760 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:32.443760 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:32.443760 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:32.443760 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:32.443760 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:32.443760 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 00:43:32.443760 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 00:43:32.443760 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 00:43:32.444638 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 00:43:32.444638 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:32.444638 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:32.444638 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:32.444638 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:32.444638 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:32.444638 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:32.444638 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:32.444638 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:32.444638 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:32.444638 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:32.444638 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:32.444638 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:32.444638 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:32.444638 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:32.444638 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:32.444638 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:32.445558 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 00:43:32.445558 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 00:43:32.445558 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 00:43:32.445558 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 00:43:32.445558 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 00:43:32.445558 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 00:43:32.445558 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:43:32.445558 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:32.445558 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 320/649] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 23 00:43:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:32.450770 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79176ea6-2527-4239-809c-528be5b38e68 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:32.485925 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae104049-f3c5-4a09-8611-2f65927a43e3 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:32.486253 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae104049-f3c5-4a09-8611-2f65927a43e3 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:32.486512 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae104049-f3c5-4a09-8611-2f65927a43e3 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:32.487862 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 321/650] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:43:32.493484 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2322369-7bd3-4fca-a517-28a4af32289f None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:32.494029 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2322369-7bd3-4fca-a517-28a4af32289f None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:32.494544 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2322369-7bd3-4fca-a517-28a4af32289f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:32.516107 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-c2322369-7bd3-4fca-a517-28a4af32289f None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:32.518322 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-c2322369-7bd3-4fca-a517-28a4af32289f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:32.570150 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79176ea6-2527-4239-809c-528be5b38e68 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:32.597078 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 322/651] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:32 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 00:43:32.597913 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2322369-7bd3-4fca-a517-28a4af32289f None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:32.606516 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:32.615654 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc64322d-d325-4d8b-a0d0-d33402ad6a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:32.616263 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64322d-d325-4d8b-a0d0-d33402ad6a14 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:32.616540 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64322d-d325-4d8b-a0d0-d33402ad6a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:32.616810 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64322d-d325-4d8b-a0d0-d33402ad6a14 None admin] PATH_INFO: `/v3/projects` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:32.617497 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc64322d-d325-4d8b-a0d0-d33402ad6a14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:32.617795 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc64322d-d325-4d8b-a0d0-d33402ad6a14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:32.619632 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc64322d-d325-4d8b-a0d0-d33402ad6a14 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:32.637566 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 330/652] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 23 00:43:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:32.638540 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc64322d-d325-4d8b-a0d0-d33402ad6a14 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:32.642531 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:32.719323 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2322369-7bd3-4fca-a517-28a4af32289f None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:32.750270 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc64322d-d325-4d8b-a0d0-d33402ad6a14 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:32.756116 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1431714-999e-4ba8-99ef-b7e57e644db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:32.756737 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1431714-999e-4ba8-99ef-b7e57e644db6 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:32.757014 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1431714-999e-4ba8-99ef-b7e57e644db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:32.757281 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1431714-999e-4ba8-99ef-b7e57e644db6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:32.757859 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1431714-999e-4ba8-99ef-b7e57e644db6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:32.759662 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1431714-999e-4ba8-99ef-b7e57e644db6 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:32.770461 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-e1431714-999e-4ba8-99ef-b7e57e644db6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 23 00:43:32.770461 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:32.770461 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:43:32.770461 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:43:32.770461 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:43:32.770461 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:43:32.770461 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:43:32.770461 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:43:32.770461 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 23 00:43:32.770461 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:32.770461 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:43:32.770461 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:32.770461 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:32.770461 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:32.770461 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:32.770461 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:32.770461 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:32.771605 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:32.771605 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:32.771605 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:32.771605 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:32.771605 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:32.771605 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:32.771605 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:43:32.771605 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:43:32.771605 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:43:32.771605 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:43:32.771605 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:32.771605 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:32.771605 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:32.771605 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:32.771605 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:32.771605 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:32.772660 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:32.772660 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:32.772660 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:32.772660 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:32.772660 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:32.772660 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:32.772660 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:32.772660 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:32.772660 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:32.772660 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:32.772660 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:43:32.772660 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:43:32.772660 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 23 00:43:32.772660 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:32.772660 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 323/653] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 23 00:43:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:32.773646 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1431714-999e-4ba8-99ef-b7e57e644db6 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:32.791043 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728fb4c-bc9a-4537-8520-c6306487f25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:32.793002 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728fb4c-bc9a-4537-8520-c6306487f25a None admin] REQUEST_METHOD: `PUT` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:32.793283 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728fb4c-bc9a-4537-8520-c6306487f25a None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:32.793557 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728fb4c-bc9a-4537-8520-c6306487f25a None admin] PATH_INFO: `/v3/projects/60f8594760e44ce3888a32702ea9afcc/users/f183fd83a96a4af0bc9df03e6f61ca4a/roles/e1cc8c321c304deaa299e74b57532d98` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:32.795748 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b728fb4c-bc9a-4537-8520-c6306487f25a None admin] RBAC: Authorizing `identity:create_grant(project_id=60f8594760e44ce3888a32702ea9afcc, user_id=f183fd83a96a4af0bc9df03e6f61ca4a, role_id=e1cc8c321c304deaa299e74b57532d98)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:32.797183 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b728fb4c-bc9a-4537-8520-c6306487f25a None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:32.810327 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 331/654] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 23 00:43:32 2022] PUT /identity/v3/projects/60f8594760e44ce3888a32702ea9afcc/users/f183fd83a96a4af0bc9df03e6f61ca4a/roles/e1cc8c321c304deaa299e74b57532d98 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:43:32.815111 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728fb4c-bc9a-4537-8520-c6306487f25a None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:32.882038 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:32.907240 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:32.914522 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1431714-999e-4ba8-99ef-b7e57e644db6 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:32.942542 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728fb4c-bc9a-4537-8520-c6306487f25a None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:32.951499 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60d486-f57d-4f52-82be-c25f4b777dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:32.952415 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60d486-f57d-4f52-82be-c25f4b777dfe None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:32.952859 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60d486-f57d-4f52-82be-c25f4b777dfe None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:32.953135 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60d486-f57d-4f52-82be-c25f4b777dfe None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:32.953725 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a60d486-f57d-4f52-82be-c25f4b777dfe None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:32.955266 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a60d486-f57d-4f52-82be-c25f4b777dfe None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:32.968446 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-1a60d486-f57d-4f52-82be-c25f4b777dfe None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 00:43:32.968446 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:32.968446 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:43:32.968446 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:43:32.968446 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:43:32.968446 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:43:32.968446 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:43:32.968446 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:43:32.968446 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 00:43:32.968446 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:32.968446 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:43:32.968446 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:32.968446 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:32.968446 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:32.968446 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:32.968446 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:32.968446 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:32.969742 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:32.969742 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:32.969742 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:32.969742 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:32.969742 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:32.969742 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:32.969742 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:43:32.969742 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:43:32.969742 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:43:32.969742 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:43:32.969742 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:32.969742 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:32.969742 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:32.969742 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:32.969742 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:32.969742 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:32.970976 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:32.970976 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:32.970976 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:32.970976 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:32.970976 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:32.970976 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:32.970976 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:32.970976 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:32.970976 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:32.970976 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:32.970976 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:43:32.970976 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:43:32.970976 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 00:43:32.970976 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:32.970976 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 324/655] 10.222.0.23 () {56 vars in 1126 bytes} [Sun Oct 23 00:43:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:32.971784 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60d486-f57d-4f52-82be-c25f4b777dfe None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:32.989903 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d0bc3-f842-4af1-b918-8b970bab7bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:32.990602 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d0bc3-f842-4af1-b918-8b970bab7bd7 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:32.990839 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d0bc3-f842-4af1-b918-8b970bab7bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:32.991111 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d0bc3-f842-4af1-b918-8b970bab7bd7 None admin] PATH_INFO: `/v3/services` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:32.991780 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d0bc3-f842-4af1-b918-8b970bab7bd7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:32.992043 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d0bc3-f842-4af1-b918-8b970bab7bd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:32.993411 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d0bc3-f842-4af1-b918-8b970bab7bd7 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:32.998233 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 332/656] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 23 00:43:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:32.999039 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d0bc3-f842-4af1-b918-8b970bab7bd7 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:33.084658 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60d486-f57d-4f52-82be-c25f4b777dfe None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:33.106536 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d0bc3-f842-4af1-b918-8b970bab7bd7 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:33.120045 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b607604-32db-4c8a-b8dd-549ca55ab8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:33.120654 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b607604-32db-4c8a-b8dd-549ca55ab8b3 None admin] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:33.120943 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b607604-32db-4c8a-b8dd-549ca55ab8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:33.121216 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b607604-32db-4c8a-b8dd-549ca55ab8b3 None admin] PATH_INFO: `/v3/services` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:33.121863 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b607604-32db-4c8a-b8dd-549ca55ab8b3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:33.123282 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b607604-32db-4c8a-b8dd-549ca55ab8b3 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:33.124023 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:33.140736 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 325/657] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Oct 23 00:43:32 2022] POST /identity/v3/services => generated 269 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:43:33.141723 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b607604-32db-4c8a-b8dd-549ca55ab8b3 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:33.162734 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4593a-cfc4-48eb-97ef-6dbdeb8c413e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:33.163955 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4593a-cfc4-48eb-97ef-6dbdeb8c413e None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:33.164428 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4593a-cfc4-48eb-97ef-6dbdeb8c413e None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:33.165171 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4593a-cfc4-48eb-97ef-6dbdeb8c413e None admin] PATH_INFO: `/v3/services` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:33.166573 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b4593a-cfc4-48eb-97ef-6dbdeb8c413e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:33.167120 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b4593a-cfc4-48eb-97ef-6dbdeb8c413e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:33.168858 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b4593a-cfc4-48eb-97ef-6dbdeb8c413e None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:33.170416 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:33.181474 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 333/658] 10.222.0.23 () {56 vars in 1122 bytes} [Sun Oct 23 00:43:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:33.183642 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4593a-cfc4-48eb-97ef-6dbdeb8c413e None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:33.285036 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b607604-32db-4c8a-b8dd-549ca55ab8b3 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:33.313052 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4593a-cfc4-48eb-97ef-6dbdeb8c413e None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:33.335826 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84012af4-2988-4ba6-8a3a-5cf5cdeb6322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:33.336829 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84012af4-2988-4ba6-8a3a-5cf5cdeb6322 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:33.336829 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84012af4-2988-4ba6-8a3a-5cf5cdeb6322 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:33.337004 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84012af4-2988-4ba6-8a3a-5cf5cdeb6322 None admin] PATH_INFO: `/v3/services` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:33.337609 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84012af4-2988-4ba6-8a3a-5cf5cdeb6322 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:33.337913 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84012af4-2988-4ba6-8a3a-5cf5cdeb6322 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:33.339502 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84012af4-2988-4ba6-8a3a-5cf5cdeb6322 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:33.345672 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 326/659] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 23 00:43:33 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:33.353642 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b372d00-9c32-4e9e-b164-deef52bef22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:33.356144 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b372d00-9c32-4e9e-b164-deef52bef22a None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:33.356144 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b372d00-9c32-4e9e-b164-deef52bef22a None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:33.356144 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b372d00-9c32-4e9e-b164-deef52bef22a None admin] PATH_INFO: `/v3/services` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:33.356144 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b372d00-9c32-4e9e-b164-deef52bef22a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:33.356144 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b372d00-9c32-4e9e-b164-deef52bef22a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:33.357523 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b372d00-9c32-4e9e-b164-deef52bef22a None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:33.366212 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 334/660] 10.222.0.23 () {56 vars in 1122 bytes} [Sun Oct 23 00:43:33 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:43:34.974481 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37a3eb-b27e-4c95-83d4-51bfba1620a0 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:34.975011 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37a3eb-b27e-4c95-83d4-51bfba1620a0 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:34.975011 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37a3eb-b27e-4c95-83d4-51bfba1620a0 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:34.976591 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 327/661] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:43:34.982265 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81e145-ec71-426d-ac52-71bb3c7344d4 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:34.982725 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81e145-ec71-426d-ac52-71bb3c7344d4 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:34.982807 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81e145-ec71-426d-ac52-71bb3c7344d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:35.001655 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-cc81e145-ec71-426d-ac52-71bb3c7344d4 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:35.002851 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-cc81e145-ec71-426d-ac52-71bb3c7344d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:35.039598 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:35.076290 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 335/662] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:34 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:43:35.347211 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37a3eb-b27e-4c95-83d4-51bfba1620a0 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:35.423655 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f925a6-002b-46af-802b-c09fb69dc6ec None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:35.424020 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f925a6-002b-46af-802b-c09fb69dc6ec None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:35.424274 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f925a6-002b-46af-802b-c09fb69dc6ec None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:35.426112 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 336/663] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:43:35.432728 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200279c1-d4be-4521-810d-67a7368a3ae5 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:35.433045 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200279c1-d4be-4521-810d-67a7368a3ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:35.433275 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200279c1-d4be-4521-810d-67a7368a3ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:35.441038 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:35.454442 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-200279c1-d4be-4521-810d-67a7368a3ae5 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:35.456196 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-200279c1-d4be-4521-810d-67a7368a3ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:35.460326 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37a3eb-b27e-4c95-83d4-51bfba1620a0 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:35.498546 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c81382-d0e1-47a4-8d41-90632eaa0248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:35.499157 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c81382-d0e1-47a4-8d41-90632eaa0248 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:35.499445 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c81382-d0e1-47a4-8d41-90632eaa0248 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:35.499718 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c81382-d0e1-47a4-8d41-90632eaa0248 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:35.512501 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c81382-d0e1-47a4-8d41-90632eaa0248 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:43:35.517508 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-61c81382-d0e1-47a4-8d41-90632eaa0248 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 23 00:43:35.517508 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:35.517508 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:35.517508 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:35.517508 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:35.517508 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:35.517508 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:35.517508 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:35.517508 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:35.517508 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:35.517508 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:35.517508 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:35.517508 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:43:35.517508 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:43:35.517508 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:43:35.517508 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:43:35.518518 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:43:35.518518 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:43:35.518518 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:43:35.518518 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:43:35.518518 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:35.518518 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:35.518518 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:35.518518 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:35.518518 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:35.518518 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:35.518518 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:35.518518 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:35.518518 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:35.518518 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:35.518518 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:35.518518 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:35.522994 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:35.522994 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:35.522994 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:35.522994 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:35.522994 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:43:35.522994 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:43:35.522994 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:43:35.522994 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:43:35.522994 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:43:35.522994 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:43:35.522994 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 23 00:43:35.522994 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:35.522994 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 328/664] 10.222.0.23 () {56 vars in 1120 bytes} [Sun Oct 23 00:43:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:35.526648 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c81382-d0e1-47a4-8d41-90632eaa0248 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:35.561682 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 337/665] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:35 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 00:43:35.561682 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910decc6-0bb2-4b94-8ea8-b031d81c3304 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:35.561682 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910decc6-0bb2-4b94-8ea8-b031d81c3304 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:35.562008 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910decc6-0bb2-4b94-8ea8-b031d81c3304 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:35.567281 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 338/666] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:43:35.568855 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b221f-0a8c-4256-8383-6b76db1e08d0 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:35.569137 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b221f-0a8c-4256-8383-6b76db1e08d0 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:35.569510 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b221f-0a8c-4256-8383-6b76db1e08d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:35.587979 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-3d5b221f-0a8c-4256-8383-6b76db1e08d0 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:35.589275 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-3d5b221f-0a8c-4256-8383-6b76db1e08d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:35.646772 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c81382-d0e1-47a4-8d41-90632eaa0248 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:35.665370 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 339/667] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:35 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 00:43:35.665370 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57974269-11c6-47c7-8b9d-4e00e5462946 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:35.665370 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57974269-11c6-47c7-8b9d-4e00e5462946 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:35.665370 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57974269-11c6-47c7-8b9d-4e00e5462946 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:35.665370 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 340/668] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:43:35.670724 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fb986-f1c9-405b-9d46-f6cd71d9d95c None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:35.671015 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fb986-f1c9-405b-9d46-f6cd71d9d95c None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:35.671291 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fb986-f1c9-405b-9d46-f6cd71d9d95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:35.687214 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c413753-0561-4719-ada6-01a73e0b4b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:35.688188 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c413753-0561-4719-ada6-01a73e0b4b99 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:35.688796 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c413753-0561-4719-ada6-01a73e0b4b99 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:35.689256 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c413753-0561-4719-ada6-01a73e0b4b99 None admin] PATH_INFO: `/v3/roles` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:35.689525 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-f61fb986-f1c9-405b-9d46-f6cd71d9d95c None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:35.690380 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c413753-0561-4719-ada6-01a73e0b4b99 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:35.690735 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-f61fb986-f1c9-405b-9d46-f6cd71d9d95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:35.691117 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c413753-0561-4719-ada6-01a73e0b4b99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:35.693039 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c413753-0561-4719-ada6-01a73e0b4b99 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:35.708746 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 329/669] 10.222.0.23 () {56 vars in 1115 bytes} [Sun Oct 23 00:43:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:35.714107 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c413753-0561-4719-ada6-01a73e0b4b99 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:35.716974 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:35.742436 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:35.768952 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 341/670] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:35 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 00:43:35.827281 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c413753-0561-4719-ada6-01a73e0b4b99 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:35.829711 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61fb986-f1c9-405b-9d46-f6cd71d9d95c None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:35.870214 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d3577-e4f8-4abb-a00d-63be866ba93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:35.871468 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d3577-e4f8-4abb-a00d-63be866ba93a None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:35.871944 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d3577-e4f8-4abb-a00d-63be866ba93a None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:35.872408 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d3577-e4f8-4abb-a00d-63be866ba93a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:35.886507 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d3577-e4f8-4abb-a00d-63be866ba93a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:35.888685 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d3577-e4f8-4abb-a00d-63be866ba93a None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:35.907599 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-4c2d3577-e4f8-4abb-a00d-63be866ba93a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:35.907599 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:35.907599 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:35.907599 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:35.907599 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:35.907599 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:35.907599 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:35.907599 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:35.907599 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:35.907599 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:35.907599 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:35.907599 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:35.907599 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:43:35.907599 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:43:35.907599 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:43:35.907599 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:43:35.908541 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:35.908541 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:35.908541 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:35.908541 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:35.908541 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:35.908541 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:35.908541 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:35.908541 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:35.908541 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:35.908541 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:35.908541 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:35.908541 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:35.908541 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:35.908541 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:35.908541 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:35.908541 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:35.908541 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:43:35.909422 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:43:35.909422 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:35.909422 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:35.912052 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 330/671] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:43:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:35.917444 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d3577-e4f8-4abb-a00d-63be866ba93a None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:35.941258 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61fb986-f1c9-405b-9d46-f6cd71d9d95c None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:35.977172 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29597def-864a-4d86-b216-56a682ae6afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:35.977802 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29597def-864a-4d86-b216-56a682ae6afb None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:35.978102 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29597def-864a-4d86-b216-56a682ae6afb None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:35.978403 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29597def-864a-4d86-b216-56a682ae6afb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:35.978989 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29597def-864a-4d86-b216-56a682ae6afb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:35.980363 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29597def-864a-4d86-b216-56a682ae6afb None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:35.980997 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:35.989340 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-29597def-864a-4d86-b216-56a682ae6afb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 23 00:43:35.989340 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:35.989340 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:43:35.989340 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:43:35.989340 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:43:35.989340 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:43:35.989340 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:43:35.989340 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:43:35.989340 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 23 00:43:35.989340 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:35.989340 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:43:35.989340 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:35.989340 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:35.989340 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:35.989340 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:35.989340 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:35.994378 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:35.994378 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:35.994378 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:35.994378 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:35.994378 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:35.994378 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:35.994378 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:35.994378 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:43:35.994378 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:43:35.994378 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:43:35.994378 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:43:35.994378 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:35.994378 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:35.994378 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:35.994378 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:35.994378 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:35.994378 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:35.995284 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:35.995284 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:35.995284 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:35.995284 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:35.995284 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:35.995284 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:35.995284 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:35.995284 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:35.995284 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:35.995284 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:35.995284 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:43:35.995284 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:43:35.995284 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 23 00:43:35.995284 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:35.995284 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 342/672] 10.222.0.23 () {56 vars in 1132 bytes} [Sun Oct 23 00:43:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:35.996133 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29597def-864a-4d86-b216-56a682ae6afb None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:36.022179 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:36.035223 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d3577-e4f8-4abb-a00d-63be866ba93a None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:36.068347 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3862c-1b15-4938-a6e0-8dbe1354c1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:36.068950 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3862c-1b15-4938-a6e0-8dbe1354c1f4 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:36.069226 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3862c-1b15-4938-a6e0-8dbe1354c1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:36.069504 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3862c-1b15-4938-a6e0-8dbe1354c1f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:36.070173 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c3862c-1b15-4938-a6e0-8dbe1354c1f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:36.070476 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c3862c-1b15-4938-a6e0-8dbe1354c1f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:36.071864 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c3862c-1b15-4938-a6e0-8dbe1354c1f4 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:36.084069 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 331/673] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:36.084703 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3862c-1b15-4938-a6e0-8dbe1354c1f4 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:36.102334 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29597def-864a-4d86-b216-56a682ae6afb None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:36.136215 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a406650-ee87-4e5e-879d-9c577b9be57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:36.136857 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a406650-ee87-4e5e-879d-9c577b9be57e None admin] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:36.137135 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a406650-ee87-4e5e-879d-9c577b9be57e None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:36.137411 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a406650-ee87-4e5e-879d-9c577b9be57e None admin] PATH_INFO: `/v3/services` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:36.138057 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a406650-ee87-4e5e-879d-9c577b9be57e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:36.139441 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a406650-ee87-4e5e-879d-9c577b9be57e None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:36.154224 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 343/674] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Oct 23 00:43:35 2022] POST /identity/v3/services => generated 251 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:43:36.154831 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a406650-ee87-4e5e-879d-9c577b9be57e None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:36.185936 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3862c-1b15-4938-a6e0-8dbe1354c1f4 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:36.208360 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:36.235929 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c534e3c7-326c-40b0-a066-34e64385d921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:36.236653 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c534e3c7-326c-40b0-a066-34e64385d921 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:36.236928 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c534e3c7-326c-40b0-a066-34e64385d921 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:36.237195 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c534e3c7-326c-40b0-a066-34e64385d921 None admin] PATH_INFO: `/v3/services` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:36.237827 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c534e3c7-326c-40b0-a066-34e64385d921 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:36.238150 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c534e3c7-326c-40b0-a066-34e64385d921 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:36.239576 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c534e3c7-326c-40b0-a066-34e64385d921 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:36.248738 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 332/675] 10.222.0.23 () {56 vars in 1126 bytes} [Sun Oct 23 00:43:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:36.249679 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c534e3c7-326c-40b0-a066-34e64385d921 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:36.264681 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:36.288190 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a406650-ee87-4e5e-879d-9c577b9be57e None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:36.324498 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089c711-100c-4782-99ee-e86abdb632fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:36.325204 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089c711-100c-4782-99ee-e86abdb632fd None admin] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:36.325557 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089c711-100c-4782-99ee-e86abdb632fd None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:36.325901 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089c711-100c-4782-99ee-e86abdb632fd None admin] PATH_INFO: `/v3/services` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:36.327355 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8089c711-100c-4782-99ee-e86abdb632fd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:36.329576 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8089c711-100c-4782-99ee-e86abdb632fd None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:36.345890 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 344/676] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Oct 23 00:43:36 2022] POST /identity/v3/services => generated 241 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:43:36.346815 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089c711-100c-4782-99ee-e86abdb632fd None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:36.376142 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c534e3c7-326c-40b0-a066-34e64385d921 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:36.423144 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc3633-0574-45f2-b702-e341a3ee9ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:36.424055 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc3633-0574-45f2-b702-e341a3ee9ed3 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:36.424491 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc3633-0574-45f2-b702-e341a3ee9ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:36.424918 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc3633-0574-45f2-b702-e341a3ee9ed3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:36.435241 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fc3633-0574-45f2-b702-e341a3ee9ed3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:36.437159 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fc3633-0574-45f2-b702-e341a3ee9ed3 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:36.452882 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-73fc3633-0574-45f2-b702-e341a3ee9ed3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 23 00:43:36.452882 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:36.452882 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:36.452882 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:36.452882 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:36.452882 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:36.452882 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:36.452882 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:36.452882 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:36.452882 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:36.452882 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:36.452882 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:36.452882 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 00:43:36.452882 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 00:43:36.452882 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 00:43:36.452882 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 00:43:36.454021 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:36.454021 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:36.454021 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:43:36.454021 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:43:36.454021 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:43:36.454021 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:43:36.454021 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:36.454021 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:36.454021 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:36.454021 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:36.454021 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:36.454021 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:36.454021 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:36.454021 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:36.454021 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:36.454021 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:36.454021 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:36.454021 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:36.455492 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:36.455492 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:36.455492 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 00:43:36.455492 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 00:43:36.455492 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 00:43:36.455492 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 00:43:36.455492 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 00:43:36.455492 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 00:43:36.455492 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 23 00:43:36.455492 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:36.455492 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 333/677] 10.222.0.23 () {56 vars in 1117 bytes} [Sun Oct 23 00:43:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:36.459734 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc3633-0574-45f2-b702-e341a3ee9ed3 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:36.496353 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089c711-100c-4782-99ee-e86abdb632fd None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:36.502292 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:36.539114 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad2cce-da3e-4e7a-ac0d-6a181f5d26a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:36.539967 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad2cce-da3e-4e7a-ac0d-6a181f5d26a7 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:36.540890 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad2cce-da3e-4e7a-ac0d-6a181f5d26a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:36.541360 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad2cce-da3e-4e7a-ac0d-6a181f5d26a7 None admin] PATH_INFO: `/v3/services` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:36.542184 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad2cce-da3e-4e7a-ac0d-6a181f5d26a7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:36.542631 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad2cce-da3e-4e7a-ac0d-6a181f5d26a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:36.544146 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad2cce-da3e-4e7a-ac0d-6a181f5d26a7 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:36.549788 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 345/678] 10.222.0.23 () {56 vars in 1126 bytes} [Sun Oct 23 00:43:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:36.556258 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad2cce-da3e-4e7a-ac0d-6a181f5d26a7 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:36.569049 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:36.583834 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc3633-0574-45f2-b702-e341a3ee9ed3 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:36.622910 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ae03e-7c5b-4f54-b51f-fa257f81071a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:36.623521 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ae03e-7c5b-4f54-b51f-fa257f81071a None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:36.623803 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ae03e-7c5b-4f54-b51f-fa257f81071a None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:36.624079 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ae03e-7c5b-4f54-b51f-fa257f81071a None admin] PATH_INFO: `/v3/users` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:36.624809 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184ae03e-7c5b-4f54-b51f-fa257f81071a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:36.625118 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184ae03e-7c5b-4f54-b51f-fa257f81071a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:36.626612 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184ae03e-7c5b-4f54-b51f-fa257f81071a None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:36.645717 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 334/679] 10.222.0.23 () {56 vars in 1149 bytes} [Sun Oct 23 00:43:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:43:36.651054 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ae03e-7c5b-4f54-b51f-fa257f81071a None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:36.687789 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad2cce-da3e-4e7a-ac0d-6a181f5d26a7 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:36.723996 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867cff7a-2633-4bbb-8508-d3af7fcb1501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:36.724961 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867cff7a-2633-4bbb-8508-d3af7fcb1501 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:36.725478 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867cff7a-2633-4bbb-8508-d3af7fcb1501 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:36.725947 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867cff7a-2633-4bbb-8508-d3af7fcb1501 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:36.726986 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867cff7a-2633-4bbb-8508-d3af7fcb1501 None admin] RBAC: Adding query filter params (interface=public, service_id=f7a91c56689d463a9f5545fd46e1d9d1, region_id=RegionOne) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:36.727507 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867cff7a-2633-4bbb-8508-d3af7fcb1501 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:36.729073 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867cff7a-2633-4bbb-8508-d3af7fcb1501 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:36.737602 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 346/680] 10.222.0.23 () {56 vars in 1251 bytes} [Sun Oct 23 00:43:36 2022] GET /identity/v3/endpoints?service_id=f7a91c56689d463a9f5545fd46e1d9d1&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:43:36.747069 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867cff7a-2633-4bbb-8508-d3af7fcb1501 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:36.770956 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:36.783326 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ae03e-7c5b-4f54-b51f-fa257f81071a None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:36.827883 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:36.830971 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8831658-4798-4fac-a749-3f64669f8de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:36.831594 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8831658-4798-4fac-a749-3f64669f8de7 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:36.831872 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8831658-4798-4fac-a749-3f64669f8de7 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:36.832149 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8831658-4798-4fac-a749-3f64669f8de7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:36.865146 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867cff7a-2633-4bbb-8508-d3af7fcb1501 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:36.903519 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab8c20-8b26-4422-a365-4f7fc304d41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:36.904420 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab8c20-8b26-4422-a365-4f7fc304d41e None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:36.904847 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab8c20-8b26-4422-a365-4f7fc304d41e None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:36.905221 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab8c20-8b26-4422-a365-4f7fc304d41e None admin] PATH_INFO: `/v3/services` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:36.905933 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab8c20-8b26-4422-a365-4f7fc304d41e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:36.907687 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab8c20-8b26-4422-a365-4f7fc304d41e None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:36.921555 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 347/681] 10.222.0.23 () {56 vars in 1087 bytes} [Sun Oct 23 00:43:36 2022] GET /identity/v3/services => generated 1497 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:43:36.921759 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8831658-4798-4fac-a749-3f64669f8de7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:36.923316 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8831658-4798-4fac-a749-3f64669f8de7 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:37.026255 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:37.037429 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 335/682] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 23 00:43:36 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 23 00:43:37.043396 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab8c20-8b26-4422-a365-4f7fc304d41e None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:37.167420 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab8c20-8b26-4422-a365-4f7fc304d41e None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:37.203787 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebccbd-a1f5-47b6-b1fc-130b1d6f398c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:37.204482 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebccbd-a1f5-47b6-b1fc-130b1d6f398c None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:37.204764 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebccbd-a1f5-47b6-b1fc-130b1d6f398c None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:37.205033 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebccbd-a1f5-47b6-b1fc-130b1d6f398c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:37.208195 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:37.216922 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ebccbd-a1f5-47b6-b1fc-130b1d6f398c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:37.218933 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ebccbd-a1f5-47b6-b1fc-130b1d6f398c None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:37.239253 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-92ebccbd-a1f5-47b6-b1fc-130b1d6f398c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:37.239253 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:37.239253 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:37.239253 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:37.239253 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:37.239253 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:37.239253 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:37.239253 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:37.239253 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:37.239253 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:37.239253 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:37.239253 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:37.239253 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:43:37.239253 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:43:37.239253 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:43:37.239253 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:43:37.240178 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:37.240178 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:37.240178 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:37.240178 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:37.240178 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:37.240178 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:37.240178 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:37.240178 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:37.240178 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:37.240178 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:37.240178 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:37.240178 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:37.240178 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:37.240178 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:37.240178 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:37.240178 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:37.240178 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:43:37.241056 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:43:37.241056 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:37.241056 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:37.243137 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 348/683] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:43:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:37.249388 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8831658-4798-4fac-a749-3f64669f8de7 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:37.355528 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8831658-4798-4fac-a749-3f64669f8de7 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:37.390651 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb3fdb-2005-44f7-b97c-6fc83f212920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:37.391256 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb3fdb-2005-44f7-b97c-6fc83f212920 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:37.391539 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb3fdb-2005-44f7-b97c-6fc83f212920 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:37.391814 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb3fdb-2005-44f7-b97c-6fc83f212920 None admin] PATH_INFO: `/v3/domains` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:37.392454 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb3fdb-2005-44f7-b97c-6fc83f212920 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:37.392756 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb3fdb-2005-44f7-b97c-6fc83f212920 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:37.394136 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb3fdb-2005-44f7-b97c-6fc83f212920 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:37.410484 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 336/684] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:37.415127 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebccbd-a1f5-47b6-b1fc-130b1d6f398c None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:37.543948 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebccbd-a1f5-47b6-b1fc-130b1d6f398c None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:37.590874 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d41bd5-f18b-4692-a207-92cc4d0ff394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:37.591853 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d41bd5-f18b-4692-a207-92cc4d0ff394 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:37.592368 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d41bd5-f18b-4692-a207-92cc4d0ff394 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:37.592839 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d41bd5-f18b-4692-a207-92cc4d0ff394 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:37.599817 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d41bd5-f18b-4692-a207-92cc4d0ff394 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:37.601469 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d41bd5-f18b-4692-a207-92cc4d0ff394 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:37.612947 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-17d41bd5-f18b-4692-a207-92cc4d0ff394 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:43:37.612947 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:37.612947 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:37.612947 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:37.612947 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:37.612947 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:37.612947 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:37.612947 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:37.612947 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:37.612947 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:37.612947 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:37.612947 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:37.612947 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 00:43:37.612947 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 00:43:37.612947 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 00:43:37.613821 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 00:43:37.613821 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:37.613821 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:37.613821 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:37.613821 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:37.613821 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:37.613821 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:37.613821 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:37.613821 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:37.613821 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:37.613821 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:37.613821 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:37.613821 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:37.613821 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:37.613821 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:37.613821 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:37.613821 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:37.614720 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 00:43:37.614720 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 00:43:37.614720 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 00:43:37.614720 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 00:43:37.614720 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 00:43:37.614720 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 00:43:37.614720 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:43:37.614720 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:37.616953 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 349/685] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 23 00:43:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:37.622856 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb3fdb-2005-44f7-b97c-6fc83f212920 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:37.677161 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:37.739368 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb3fdb-2005-44f7-b97c-6fc83f212920 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:37.775237 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b98c42-09cb-4284-a12b-5ad3a5250388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:37.776183 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b98c42-09cb-4284-a12b-5ad3a5250388 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:37.776663 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b98c42-09cb-4284-a12b-5ad3a5250388 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:37.777151 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b98c42-09cb-4284-a12b-5ad3a5250388 None admin] PATH_INFO: `/v3/projects` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:37.778035 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b98c42-09cb-4284-a12b-5ad3a5250388 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:37.778580 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b98c42-09cb-4284-a12b-5ad3a5250388 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:37.780189 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b98c42-09cb-4284-a12b-5ad3a5250388 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:37.792981 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 337/686] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 23 00:43:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:37.799190 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d41bd5-f18b-4692-a207-92cc4d0ff394 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:37.850988 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:37.905864 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d41bd5-f18b-4692-a207-92cc4d0ff394 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:37.944204 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43919236-40b7-4850-a238-0cda6e37532b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:37.945185 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43919236-40b7-4850-a238-0cda6e37532b None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:37.945665 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43919236-40b7-4850-a238-0cda6e37532b None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:37.946160 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43919236-40b7-4850-a238-0cda6e37532b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:37.947099 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43919236-40b7-4850-a238-0cda6e37532b None admin] RBAC: Adding query filter params (role.id=e1cc8c321c304deaa299e74b57532d98, scope.project.id=60f8594760e44ce3888a32702ea9afcc, user.id=f183fd83a96a4af0bc9df03e6f61ca4a) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:37.947603 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43919236-40b7-4850-a238-0cda6e37532b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:37.949263 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43919236-40b7-4850-a238-0cda6e37532b None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:37.955740 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 350/687] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 23 00:43:37 2022] GET /identity/v3/role_assignments?user.id=f183fd83a96a4af0bc9df03e6f61ca4a&scope.project.id=60f8594760e44ce3888a32702ea9afcc&role.id=e1cc8c321c304deaa299e74b57532d98 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:43:38.510540 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c05785-b162-4cff-9617-6862aa9eada5 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:38.511198 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c05785-b162-4cff-9617-6862aa9eada5 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:38.511198 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c05785-b162-4cff-9617-6862aa9eada5 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:38.512827 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 338/688] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:43:38.518287 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd88ccc-e9b8-4ec2-a68c-49de289f6890 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:38.518716 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd88ccc-e9b8-4ec2-a68c-49de289f6890 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:38.518883 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd88ccc-e9b8-4ec2-a68c-49de289f6890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:38.538395 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-7cd88ccc-e9b8-4ec2-a68c-49de289f6890 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:38.539648 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-7cd88ccc-e9b8-4ec2-a68c-49de289f6890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:38.625262 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 351/689] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:43:38.733933 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6720f-95c4-4629-9853-2af708557d06 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:38.736094 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6720f-95c4-4629-9853-2af708557d06 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:38.736596 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6720f-95c4-4629-9853-2af708557d06 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:38.740103 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 339/690] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:43:38.745800 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f3dba-3d8e-4ebd-8895-5a4c53ef8604 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:38.746363 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f3dba-3d8e-4ebd-8895-5a4c53ef8604 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:38.746862 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f3dba-3d8e-4ebd-8895-5a4c53ef8604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:38.770730 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-812f3dba-3d8e-4ebd-8895-5a4c53ef8604 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:38.772103 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-812f3dba-3d8e-4ebd-8895-5a4c53ef8604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:38.817521 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:38.857894 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 352/691] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:43:38.899468 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6720f-95c4-4629-9853-2af708557d06 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:39.014663 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6720f-95c4-4629-9853-2af708557d06 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:39.032266 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:39.055875 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359833c-9330-4770-9046-f31c9df75ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:39.056811 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359833c-9330-4770-9046-f31c9df75ae8 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:39.057302 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359833c-9330-4770-9046-f31c9df75ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:39.057798 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359833c-9330-4770-9046-f31c9df75ae8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:39.058610 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3359833c-9330-4770-9046-f31c9df75ae8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:39.060166 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3359833c-9330-4770-9046-f31c9df75ae8 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:39.069609 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-3359833c-9330-4770-9046-f31c9df75ae8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 23 00:43:39.069609 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:39.069609 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:43:39.069609 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:43:39.069609 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:43:39.069609 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:43:39.069609 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:43:39.069609 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:43:39.069609 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 23 00:43:39.069609 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:39.069609 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:43:39.069609 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:39.069609 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:39.069609 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:39.069609 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:39.069609 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:39.069609 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:39.070617 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:39.070617 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:39.070617 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:39.070617 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:39.070617 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:39.070617 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:39.070617 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:43:39.070617 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:43:39.070617 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:43:39.070617 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:43:39.070617 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:39.070617 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:39.070617 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:39.070617 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:39.070617 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:39.070617 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:39.071433 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:39.071433 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:39.071433 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:39.071433 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:39.071433 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:39.071433 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:39.071433 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:39.071433 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:39.071433 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:39.071433 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:39.071433 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:43:39.071433 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:43:39.071433 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 23 00:43:39.071433 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:39.074186 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 340/692] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 23 00:43:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:43:39.082349 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f3dba-3d8e-4ebd-8895-5a4c53ef8604 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:39.149688 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359833c-9330-4770-9046-f31c9df75ae8 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:39.198381 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f3dba-3d8e-4ebd-8895-5a4c53ef8604 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:39.249247 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced0fa5-494d-4ae5-8d7c-e57920efab09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:39.250150 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced0fa5-494d-4ae5-8d7c-e57920efab09 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:39.250436 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced0fa5-494d-4ae5-8d7c-e57920efab09 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:39.250765 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced0fa5-494d-4ae5-8d7c-e57920efab09 None admin] PATH_INFO: `/v3/services` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:39.251648 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced0fa5-494d-4ae5-8d7c-e57920efab09 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:39.251958 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced0fa5-494d-4ae5-8d7c-e57920efab09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:39.254175 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced0fa5-494d-4ae5-8d7c-e57920efab09 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:39.260409 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 353/693] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 23 00:43:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:39.266226 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced0fa5-494d-4ae5-8d7c-e57920efab09 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:39.277089 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359833c-9330-4770-9046-f31c9df75ae8 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:39.313478 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0a508-ecd5-43d8-aa55-c16bd29c7b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:39.314021 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0a508-ecd5-43d8-aa55-c16bd29c7b66 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:39.314328 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0a508-ecd5-43d8-aa55-c16bd29c7b66 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:39.314600 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0a508-ecd5-43d8-aa55-c16bd29c7b66 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:39.315182 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf0a508-ecd5-43d8-aa55-c16bd29c7b66 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:39.316670 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf0a508-ecd5-43d8-aa55-c16bd29c7b66 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:39.321827 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:39.326064 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-3bf0a508-ecd5-43d8-aa55-c16bd29c7b66 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 00:43:39.326064 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:39.326064 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:43:39.326064 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:43:39.326064 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:43:39.326064 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:43:39.326064 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:43:39.326064 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:43:39.326064 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 00:43:39.326064 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:39.326064 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:43:39.326064 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:39.326064 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:39.326064 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:39.326064 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:39.326064 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:39.326064 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:39.327092 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:39.327092 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:39.327092 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:39.327092 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:39.327092 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:39.327092 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:39.327092 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:43:39.327092 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:43:39.327092 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:43:39.327092 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:43:39.327092 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:39.327092 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:39.327092 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:39.327092 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:39.327092 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:39.327092 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:39.327922 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:39.327922 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:39.327922 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:39.327922 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:39.327922 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:39.327922 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:39.327922 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:39.327922 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:39.327922 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:39.327922 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:39.327922 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:43:39.327922 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:43:39.327922 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 00:43:39.327922 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:39.327922 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 341/694] 10.222.0.23 () {56 vars in 1126 bytes} [Sun Oct 23 00:43:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:43:39.328695 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea3962-9531-4a9b-b8a3-1c65ea61a827 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:39.329278 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea3962-9531-4a9b-b8a3-1c65ea61a827 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:39.329278 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea3962-9531-4a9b-b8a3-1c65ea61a827 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:39.330683 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 342/695] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:43:39.332785 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea3962-9531-4a9b-b8a3-1c65ea61a827 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:39.378051 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:39.390578 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced0fa5-494d-4ae5-8d7c-e57920efab09 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:39.430842 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079985c-4a64-442e-ad21-8de77035bea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:39.431380 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079985c-4a64-442e-ad21-8de77035bea9 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:39.431656 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079985c-4a64-442e-ad21-8de77035bea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:39.431920 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079985c-4a64-442e-ad21-8de77035bea9 None admin] PATH_INFO: `/v3/services` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:39.432536 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4079985c-4a64-442e-ad21-8de77035bea9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:39.432830 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4079985c-4a64-442e-ad21-8de77035bea9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:39.434231 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4079985c-4a64-442e-ad21-8de77035bea9 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:39.443843 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 354/696] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 23 00:43:39 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:43:39.443843 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b3368-2fb1-4236-bb62-39834645f69e None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:39.443843 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b3368-2fb1-4236-bb62-39834645f69e None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:39.443843 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b3368-2fb1-4236-bb62-39834645f69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:39.445680 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea3962-9531-4a9b-b8a3-1c65ea61a827 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:39.460803 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-492b3368-2fb1-4236-bb62-39834645f69e None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:39.461986 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-492b3368-2fb1-4236-bb62-39834645f69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:39.483266 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf91215-0447-4299-b64c-e99834940e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:39.483863 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf91215-0447-4299-b64c-e99834940e7a None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:39.484140 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf91215-0447-4299-b64c-e99834940e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:39.484510 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf91215-0447-4299-b64c-e99834940e7a None admin] PATH_INFO: `/v3/services` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:39.485022 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf91215-0447-4299-b64c-e99834940e7a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:39.485319 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf91215-0447-4299-b64c-e99834940e7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:39.486716 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf91215-0447-4299-b64c-e99834940e7a None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:39.496073 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 343/697] 10.222.0.23 () {56 vars in 1122 bytes} [Sun Oct 23 00:43:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:39.496895 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf91215-0447-4299-b64c-e99834940e7a None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:39.530968 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 355/698] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:43:39.531880 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b3368-2fb1-4236-bb62-39834645f69e None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:39.574392 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:39.614570 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf91215-0447-4299-b64c-e99834940e7a None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:39.618481 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:39.656680 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a3e68c-4b72-4ea4-ac8d-3ff58ab33787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:39.657670 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3e68c-4b72-4ea4-ac8d-3ff58ab33787 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:39.658208 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3e68c-4b72-4ea4-ac8d-3ff58ab33787 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:39.658719 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3e68c-4b72-4ea4-ac8d-3ff58ab33787 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:39.659657 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a3e68c-4b72-4ea4-ac8d-3ff58ab33787 None admin] RBAC: Adding query filter params (interface=public, service_id=45609b3f35e740078006d628cf90704f, region_id=RegionOne) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:39.660186 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a3e68c-4b72-4ea4-ac8d-3ff58ab33787 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:39.662549 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a3e68c-4b72-4ea4-ac8d-3ff58ab33787 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:39.666592 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b3368-2fb1-4236-bb62-39834645f69e None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:39.668668 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 344/699] 10.222.0.23 () {56 vars in 1251 bytes} [Sun Oct 23 00:43:39 2022] GET /identity/v3/endpoints?service_id=45609b3f35e740078006d628cf90704f&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:39.683477 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a3e68c-4b72-4ea4-ac8d-3ff58ab33787 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:39.704656 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17743e6-ba5c-4b94-8455-617e5ac0fdaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:39.705361 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17743e6-ba5c-4b94-8455-617e5ac0fdaa None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:39.705710 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17743e6-ba5c-4b94-8455-617e5ac0fdaa None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:39.706184 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17743e6-ba5c-4b94-8455-617e5ac0fdaa None admin] PATH_INFO: `/v3/services` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:39.706886 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17743e6-ba5c-4b94-8455-617e5ac0fdaa None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:39.707788 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17743e6-ba5c-4b94-8455-617e5ac0fdaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:39.709218 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17743e6-ba5c-4b94-8455-617e5ac0fdaa None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:39.717001 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 356/700] 10.222.0.23 () {56 vars in 1122 bytes} [Sun Oct 23 00:43:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:39.722471 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17743e6-ba5c-4b94-8455-617e5ac0fdaa None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:39.808922 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a3e68c-4b72-4ea4-ac8d-3ff58ab33787 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:39.835623 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:39.843426 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17743e6-ba5c-4b94-8455-617e5ac0fdaa None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:39.845238 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444e523-d6fd-4f72-97de-c87f22c39d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:39.845852 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444e523-d6fd-4f72-97de-c87f22c39d93 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:39.846157 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444e523-d6fd-4f72-97de-c87f22c39d93 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:39.846433 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444e523-d6fd-4f72-97de-c87f22c39d93 None admin] PATH_INFO: `/v3/services` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:39.847033 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c444e523-d6fd-4f72-97de-c87f22c39d93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:39.848479 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c444e523-d6fd-4f72-97de-c87f22c39d93 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:39.862112 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 345/701] 10.222.0.23 () {56 vars in 1087 bytes} [Sun Oct 23 00:43:39 2022] GET /identity/v3/services => generated 1497 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:43:39.862112 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444e523-d6fd-4f72-97de-c87f22c39d93 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:39.893497 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:39.901733 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279745a0-fad6-4937-9135-99907caba6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:39.902399 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279745a0-fad6-4937-9135-99907caba6d0 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:39.902679 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279745a0-fad6-4937-9135-99907caba6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:39.902950 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279745a0-fad6-4937-9135-99907caba6d0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:39.903662 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279745a0-fad6-4937-9135-99907caba6d0 None admin] RBAC: Adding query filter params (interface=public, service_id=6852bb5ba5ff482797e3b89caf444edb, region_id=RegionOne) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:39.903965 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279745a0-fad6-4937-9135-99907caba6d0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:39.905939 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279745a0-fad6-4937-9135-99907caba6d0 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:39.914501 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 357/702] 10.222.0.23 () {56 vars in 1251 bytes} [Sun Oct 23 00:43:39 2022] GET /identity/v3/endpoints?service_id=6852bb5ba5ff482797e3b89caf444edb&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:39.920372 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279745a0-fad6-4937-9135-99907caba6d0 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:39.995562 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444e523-d6fd-4f72-97de-c87f22c39d93 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:40.037681 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279745a0-fad6-4937-9135-99907caba6d0 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:40.044178 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76b493-0247-455e-b923-3c9a53103e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:40.044808 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76b493-0247-455e-b923-3c9a53103e91 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:40.045142 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76b493-0247-455e-b923-3c9a53103e91 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:40.045544 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76b493-0247-455e-b923-3c9a53103e91 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:40.046153 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a76b493-0247-455e-b923-3c9a53103e91 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:40.047521 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a76b493-0247-455e-b923-3c9a53103e91 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:40.058066 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-0a76b493-0247-455e-b923-3c9a53103e91 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 23 00:43:40.058066 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:40.058066 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:43:40.058066 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:43:40.058066 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:43:40.058066 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:43:40.058066 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:43:40.058066 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:43:40.058066 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 23 00:43:40.058066 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:40.058066 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:43:40.058066 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:40.058066 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:40.058066 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:40.058066 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:40.058066 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:40.059167 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:40.059167 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:40.059167 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:40.059167 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:40.059167 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:40.059167 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:40.059167 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:40.059167 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:43:40.059167 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:43:40.059167 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:43:40.059167 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:43:40.059167 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:40.059167 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:40.059167 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:40.059167 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:40.059167 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:40.059167 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:40.060096 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:40.060096 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:40.060096 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:40.060096 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:40.060096 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:40.060096 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:40.060096 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:40.060096 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:40.060096 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:40.060096 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:40.060096 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:43:40.060096 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:43:40.060096 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 23 00:43:40.060096 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:40.062703 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 346/703] 10.222.0.23 () {56 vars in 1132 bytes} [Sun Oct 23 00:43:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:40.069814 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76b493-0247-455e-b923-3c9a53103e91 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:40.087121 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e981b-7c46-487b-b11c-561e2c47d589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:40.088065 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e981b-7c46-487b-b11c-561e2c47d589 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:40.088497 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e981b-7c46-487b-b11c-561e2c47d589 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:40.088915 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e981b-7c46-487b-b11c-561e2c47d589 None admin] PATH_INFO: `/v3/services` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:40.089712 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685e981b-7c46-487b-b11c-561e2c47d589 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:40.091195 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685e981b-7c46-487b-b11c-561e2c47d589 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:40.098934 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 358/704] 10.222.0.23 () {56 vars in 1087 bytes} [Sun Oct 23 00:43:39 2022] GET /identity/v3/services => generated 1497 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:43:40.188117 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:40.188325 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b4f69-f5f7-457d-b7f1-8d360ff55dba None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:40.188471 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b4f69-f5f7-457d-b7f1-8d360ff55dba None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:40.188657 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b4f69-f5f7-457d-b7f1-8d360ff55dba None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:40.190409 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 359/705] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:43:40.196548 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76b493-0247-455e-b923-3c9a53103e91 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:40.196744 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d7941-ceab-4f65-b9db-18c4b1320c14 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:40.196935 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d7941-ceab-4f65-b9db-18c4b1320c14 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:40.197211 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d7941-ceab-4f65-b9db-18c4b1320c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:40.217941 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-4a3d7941-ceab-4f65-b9db-18c4b1320c14 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:40.219206 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-4a3d7941-ceab-4f65-b9db-18c4b1320c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:40.237605 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b3b4e-413a-413a-bb77-7c1ed1882aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:40.238584 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b3b4e-413a-413a-bb77-7c1ed1882aae None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:40.239009 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b3b4e-413a-413a-bb77-7c1ed1882aae None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:40.239445 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b3b4e-413a-413a-bb77-7c1ed1882aae None admin] PATH_INFO: `/v3/services` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:40.240280 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b3b4e-413a-413a-bb77-7c1ed1882aae None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:40.240757 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b3b4e-413a-413a-bb77-7c1ed1882aae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:40.242277 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b3b4e-413a-413a-bb77-7c1ed1882aae None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:40.248103 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 347/706] 10.222.0.23 () {56 vars in 1126 bytes} [Sun Oct 23 00:43:40 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:40.251097 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:40.255290 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b3b4e-413a-413a-bb77-7c1ed1882aae None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:40.315970 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 360/707] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 00:43:40.371818 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b3b4e-413a-413a-bb77-7c1ed1882aae None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:40.406551 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdee4cb-f81c-4b7b-b7dd-246b9c8a3b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:40.407302 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdee4cb-f81c-4b7b-b7dd-246b9c8a3b54 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:40.407681 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdee4cb-f81c-4b7b-b7dd-246b9c8a3b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:40.408054 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdee4cb-f81c-4b7b-b7dd-246b9c8a3b54 None admin] PATH_INFO: `/v3/services` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:40.408802 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdee4cb-f81c-4b7b-b7dd-246b9c8a3b54 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:40.409203 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdee4cb-f81c-4b7b-b7dd-246b9c8a3b54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:40.411284 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdee4cb-f81c-4b7b-b7dd-246b9c8a3b54 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:40.416808 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 348/708] 10.222.0.23 () {56 vars in 1126 bytes} [Sun Oct 23 00:43:40 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:40.422360 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d7941-ceab-4f65-b9db-18c4b1320c14 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:40.536668 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d7941-ceab-4f65-b9db-18c4b1320c14 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:40.573007 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94bc80-a4d1-4e40-a41f-d7e7822e5974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:40.573899 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94bc80-a4d1-4e40-a41f-d7e7822e5974 None admin] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:40.574356 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94bc80-a4d1-4e40-a41f-d7e7822e5974 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:40.574779 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94bc80-a4d1-4e40-a41f-d7e7822e5974 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:40.575601 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a94bc80-a4d1-4e40-a41f-d7e7822e5974 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:40.577109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a94bc80-a4d1-4e40-a41f-d7e7822e5974 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:40.595988 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdee4cb-f81c-4b7b-b7dd-246b9c8a3b54 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:40.607928 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 361/709] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 23 00:43:40 2022] POST /identity/v3/endpoints => generated 347 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:43:40.631182 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:40.723519 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdee4cb-f81c-4b7b-b7dd-246b9c8a3b54 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:40.768016 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ec229-dc2f-4992-bec6-7422eb0362cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:40.768659 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ec229-dc2f-4992-bec6-7422eb0362cc None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:40.768938 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ec229-dc2f-4992-bec6-7422eb0362cc None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:40.769223 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ec229-dc2f-4992-bec6-7422eb0362cc None admin] PATH_INFO: `/v3/services/image` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:40.769844 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ec229-dc2f-4992-bec6-7422eb0362cc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:40.771396 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ec229-dc2f-4992-bec6-7422eb0362cc None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:40.781017 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-0f9ec229-dc2f-4992-bec6-7422eb0362cc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 23 00:43:40.781017 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:40.781017 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:43:40.781017 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:43:40.781017 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:43:40.781017 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:43:40.781017 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:43:40.781017 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:43:40.781017 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 23 00:43:40.781017 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:40.781017 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:43:40.781017 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:40.781017 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:40.781017 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:40.781017 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:40.781017 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:40.781017 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:40.782103 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:40.782103 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:40.782103 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:40.782103 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:40.782103 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:40.782103 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:40.782103 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:43:40.782103 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:43:40.782103 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:43:40.782103 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:43:40.782103 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:40.782103 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:40.782103 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:40.782103 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:40.782103 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:40.782103 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:40.782995 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:40.782995 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:40.782995 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:40.782995 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:40.782995 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:40.782995 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:40.782995 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:40.782995 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:40.782995 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:40.782995 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:40.782995 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:43:40.782995 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:43:40.782995 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 23 00:43:40.782995 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:40.782995 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 349/710] 10.222.0.23 () {56 vars in 1105 bytes} [Sun Oct 23 00:43:40 2022] GET /identity/v3/services/image => generated 86 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:43:40.789193 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94bc80-a4d1-4e40-a41f-d7e7822e5974 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:40.804003 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:40.910915 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94bc80-a4d1-4e40-a41f-d7e7822e5974 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:40.947044 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5ec6f-b15c-4db4-9057-68d13d20c0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:40.947657 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5ec6f-b15c-4db4-9057-68d13d20c0c1 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:40.947936 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5ec6f-b15c-4db4-9057-68d13d20c0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:40.948206 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5ec6f-b15c-4db4-9057-68d13d20c0c1 None admin] PATH_INFO: `/v3/services` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:40.948835 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5ec6f-b15c-4db4-9057-68d13d20c0c1 None admin] RBAC: Adding query filter params (name=image) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:40.949134 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5ec6f-b15c-4db4-9057-68d13d20c0c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:40.950548 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5ec6f-b15c-4db4-9057-68d13d20c0c1 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:40.960196 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 362/711] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:43:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:40.961499 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ec229-dc2f-4992-bec6-7422eb0362cc None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:41.048572 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:41.064954 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ec229-dc2f-4992-bec6-7422eb0362cc None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:41.102219 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78928f5b-482b-42ed-83a9-7f1876aa6903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:41.102838 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78928f5b-482b-42ed-83a9-7f1876aa6903 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:41.103231 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78928f5b-482b-42ed-83a9-7f1876aa6903 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:41.103510 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78928f5b-482b-42ed-83a9-7f1876aa6903 None admin] PATH_INFO: `/v3/services` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:41.104151 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78928f5b-482b-42ed-83a9-7f1876aa6903 None admin] RBAC: Adding query filter params (type=image) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:41.104456 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78928f5b-482b-42ed-83a9-7f1876aa6903 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:41.105835 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78928f5b-482b-42ed-83a9-7f1876aa6903 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:41.115577 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 350/712] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:43:40 2022] GET /identity/v3/services?type=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:42.157083 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5a90f-6787-451d-8591-2aac4fb3b2f1 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:42.157083 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5a90f-6787-451d-8591-2aac4fb3b2f1 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:42.157083 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5a90f-6787-451d-8591-2aac4fb3b2f1 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:42.158358 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 363/713] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:43:42.163815 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a96e6-726b-4980-ad5f-d8b34e47f4fa None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:42.164596 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a96e6-726b-4980-ad5f-d8b34e47f4fa None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:42.165075 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a96e6-726b-4980-ad5f-d8b34e47f4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:42.183220 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-e06a96e6-726b-4980-ad5f-d8b34e47f4fa None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:42.184704 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-e06a96e6-726b-4980-ad5f-d8b34e47f4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:42.253569 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 351/714] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:43:42.372547 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd974df-1a23-4a1e-9d75-4cf37f04b79a None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:42.372939 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd974df-1a23-4a1e-9d75-4cf37f04b79a None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:42.373123 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd974df-1a23-4a1e-9d75-4cf37f04b79a None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:42.374715 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 364/715] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:43:42.380057 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c05fed-8646-479f-9e90-09707dac4a4b None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:42.380340 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c05fed-8646-479f-9e90-09707dac4a4b None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:42.380603 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c05fed-8646-479f-9e90-09707dac4a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:42.399014 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-f1c05fed-8646-479f-9e90-09707dac4a4b None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:42.400251 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-f1c05fed-8646-479f-9e90-09707dac4a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:42.467019 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 352/716] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:43:42.542924 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd974df-1a23-4a1e-9d75-4cf37f04b79a None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:42.621374 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:42.654332 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd974df-1a23-4a1e-9d75-4cf37f04b79a None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:42.688799 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1312166-642a-475d-b43d-0533b3547035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:42.689429 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1312166-642a-475d-b43d-0533b3547035 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:42.689709 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1312166-642a-475d-b43d-0533b3547035 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:42.689982 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1312166-642a-475d-b43d-0533b3547035 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:42.690631 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1312166-642a-475d-b43d-0533b3547035 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:42.692085 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1312166-642a-475d-b43d-0533b3547035 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:42.701200 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-b1312166-642a-475d-b43d-0533b3547035 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 23 00:43:42.701200 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:42.701200 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:43:42.701200 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:43:42.701200 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:43:42.701200 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:43:42.701200 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:43:42.701200 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:43:42.701200 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 23 00:43:42.701200 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:42.701200 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:43:42.701200 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:42.701200 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:42.701200 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:42.701200 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:42.701200 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:42.701200 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:42.702193 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:42.702193 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:42.702193 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:42.702193 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:42.702193 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:42.702193 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:42.702193 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:43:42.702193 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:43:42.702193 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:43:42.702193 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:43:42.702193 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:42.702193 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:42.702193 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:42.702193 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:42.702193 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:42.702193 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:42.703023 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:42.703023 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:42.703023 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:42.703023 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:42.703023 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:42.703023 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:42.703023 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:42.703023 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:42.703023 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:42.703023 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:42.703023 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:43:42.703023 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:43:42.703023 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 23 00:43:42.703023 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:42.703023 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 365/717] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 23 00:43:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:42.709160 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c05fed-8646-479f-9e90-09707dac4a4b None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:42.730524 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:42.751670 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1312166-642a-475d-b43d-0533b3547035 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:42.818569 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c05fed-8646-479f-9e90-09707dac4a4b None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:42.855932 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766672e-e7a7-462c-9d84-2bc86c542daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:42.856839 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766672e-e7a7-462c-9d84-2bc86c542daa None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:42.857114 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766672e-e7a7-462c-9d84-2bc86c542daa None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:42.857379 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766672e-e7a7-462c-9d84-2bc86c542daa None admin] PATH_INFO: `/v3/services` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:42.858152 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4766672e-e7a7-462c-9d84-2bc86c542daa None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:42.858732 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4766672e-e7a7-462c-9d84-2bc86c542daa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:42.859793 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4766672e-e7a7-462c-9d84-2bc86c542daa None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:42.865908 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 353/718] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 23 00:43:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:42.873678 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766672e-e7a7-462c-9d84-2bc86c542daa None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:42.891020 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1312166-642a-475d-b43d-0533b3547035 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:42.941776 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca6dc4-f681-4ea2-94ed-4ad7b240517c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:42.943046 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca6dc4-f681-4ea2-94ed-4ad7b240517c None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:42.943581 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca6dc4-f681-4ea2-94ed-4ad7b240517c None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:42.944625 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca6dc4-f681-4ea2-94ed-4ad7b240517c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:42.945671 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ca6dc4-f681-4ea2-94ed-4ad7b240517c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:42.948099 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ca6dc4-f681-4ea2-94ed-4ad7b240517c None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:42.948355 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:42.950938 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:42.958314 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-01ca6dc4-f681-4ea2-94ed-4ad7b240517c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 00:43:42.958314 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:42.958314 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:43:42.958314 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:43:42.958314 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:43:42.958314 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:43:42.958314 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:43:42.958314 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:43:42.958314 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 00:43:42.958314 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:42.958314 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:43:42.958314 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:42.958314 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:42.958314 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:42.958314 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:42.958314 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:42.958314 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:42.959339 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:42.959339 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:42.959339 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:42.959339 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:42.959339 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:42.959339 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:42.959339 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:43:42.959339 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:43:42.959339 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:43:42.959339 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:43:42.959339 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:42.959339 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:42.959339 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:42.959339 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:42.959339 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:42.959339 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:42.960164 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:42.960164 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:42.960164 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:42.960164 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:42.960164 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:42.960164 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:42.960164 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:42.960164 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:42.960164 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:42.960164 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:42.960164 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:43:42.960164 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:43:42.960164 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 00:43:42.960164 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:42.960164 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 366/719] 10.222.0.23 () {56 vars in 1126 bytes} [Sun Oct 23 00:43:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:42.961582 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559fbb4-25a9-443d-891a-6f4d027f89d0 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:42.961582 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559fbb4-25a9-443d-891a-6f4d027f89d0 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:42.961751 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559fbb4-25a9-443d-891a-6f4d027f89d0 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:42.966199 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 367/720] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:43:42.967859 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0559fbb4-25a9-443d-891a-6f4d027f89d0 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:42.986733 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766672e-e7a7-462c-9d84-2bc86c542daa None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:43.022635 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf708cf5-0705-47ad-8592-40cdfc4414f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:43.023468 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf708cf5-0705-47ad-8592-40cdfc4414f2 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:43.023468 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf708cf5-0705-47ad-8592-40cdfc4414f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:43.023762 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf708cf5-0705-47ad-8592-40cdfc4414f2 None admin] PATH_INFO: `/v3/services` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:43.024377 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf708cf5-0705-47ad-8592-40cdfc4414f2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:43.024701 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf708cf5-0705-47ad-8592-40cdfc4414f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:43.026008 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf708cf5-0705-47ad-8592-40cdfc4414f2 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:43.031139 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 354/721] 10.222.0.23 () {56 vars in 1114 bytes} [Sun Oct 23 00:43:42 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:43:43.036651 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c35da5-0925-45b5-bb98-fa1f9605ceca None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:43.036935 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c35da5-0925-45b5-bb98-fa1f9605ceca None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:43.037525 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c35da5-0925-45b5-bb98-fa1f9605ceca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:43.056109 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-43c35da5-0925-45b5-bb98-fa1f9605ceca None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:43.057284 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-43c35da5-0925-45b5-bb98-fa1f9605ceca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:43.081034 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0559fbb4-25a9-443d-891a-6f4d027f89d0 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:43.117455 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7626a-10ff-4b0b-b8c6-441491f26c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:43.118050 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7626a-10ff-4b0b-b8c6-441491f26c94 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:43.118602 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7626a-10ff-4b0b-b8c6-441491f26c94 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:43.118602 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7626a-10ff-4b0b-b8c6-441491f26c94 None admin] PATH_INFO: `/v3/services` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:43.119230 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da7626a-10ff-4b0b-b8c6-441491f26c94 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:43.119527 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da7626a-10ff-4b0b-b8c6-441491f26c94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:43.120879 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da7626a-10ff-4b0b-b8c6-441491f26c94 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:43.125888 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 368/722] 10.222.0.23 () {56 vars in 1122 bytes} [Sun Oct 23 00:43:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:43.126751 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7626a-10ff-4b0b-b8c6-441491f26c94 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:43.133973 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 355/723] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:43:43.135030 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c35da5-0925-45b5-bb98-fa1f9605ceca None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:43.199801 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:43.220684 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:43.267250 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7626a-10ff-4b0b-b8c6-441491f26c94 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:43.274721 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c35da5-0925-45b5-bb98-fa1f9605ceca None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:43.310610 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222d44d-a7f1-4cba-9f0a-63960b526d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:43.311393 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222d44d-a7f1-4cba-9f0a-63960b526d70 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:43.311759 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222d44d-a7f1-4cba-9f0a-63960b526d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:43.312130 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222d44d-a7f1-4cba-9f0a-63960b526d70 None admin] PATH_INFO: `/v3/services` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:43.312912 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222d44d-a7f1-4cba-9f0a-63960b526d70 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:43.313312 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222d44d-a7f1-4cba-9f0a-63960b526d70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:43.314406 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1849afd-9e15-48b0-ad73-7b14549e0c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:43.314983 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222d44d-a7f1-4cba-9f0a-63960b526d70 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:43.315354 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1849afd-9e15-48b0-ad73-7b14549e0c3c None admin] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:43.315785 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1849afd-9e15-48b0-ad73-7b14549e0c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:43.316202 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1849afd-9e15-48b0-ad73-7b14549e0c3c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:43.318205 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1849afd-9e15-48b0-ad73-7b14549e0c3c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:43.320404 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1849afd-9e15-48b0-ad73-7b14549e0c3c None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:43.324444 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 356/724] 10.222.0.23 () {56 vars in 1122 bytes} [Sun Oct 23 00:43:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:43.330998 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222d44d-a7f1-4cba-9f0a-63960b526d70 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:43.344871 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 369/725] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 23 00:43:43 2022] POST /identity/v3/endpoints => generated 346 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:43:43.346479 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea46177-875e-488a-8bd5-92d2cbf31053 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:43.346966 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea46177-875e-488a-8bd5-92d2cbf31053 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:43.347638 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea46177-875e-488a-8bd5-92d2cbf31053 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:43.349466 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 370/726] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:43:43.355340 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e25d5-c9fc-4b4f-b25b-a28023e74f3f None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:43.356072 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e25d5-c9fc-4b4f-b25b-a28023e74f3f None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:43.356801 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e25d5-c9fc-4b4f-b25b-a28023e74f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:43.383154 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-7c8e25d5-c9fc-4b4f-b25b-a28023e74f3f None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:43.385321 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-7c8e25d5-c9fc-4b4f-b25b-a28023e74f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:43.461275 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222d44d-a7f1-4cba-9f0a-63960b526d70 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:43.486165 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 371/727] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 00:43:43.486165 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e25d5-c9fc-4b4f-b25b-a28023e74f3f None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:43.492771 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:43.500619 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e4a69-fad5-484b-add8-b470909c3ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:43.501234 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e4a69-fad5-484b-add8-b470909c3ea6 None admin] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:43.501509 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e4a69-fad5-484b-add8-b470909c3ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:43.501781 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e4a69-fad5-484b-add8-b470909c3ea6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:43.502496 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105e4a69-fad5-484b-add8-b470909c3ea6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:43.503877 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105e4a69-fad5-484b-add8-b470909c3ea6 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:43.528310 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 357/728] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 23 00:43:43 2022] POST /identity/v3/endpoints => generated 349 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:43:43.550507 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:43.618418 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e25d5-c9fc-4b4f-b25b-a28023e74f3f None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:43.667502 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e2c73-df3d-4d66-89ef-9d2c8d20dd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:43.668205 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e2c73-df3d-4d66-89ef-9d2c8d20dd82 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:43.668489 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e2c73-df3d-4d66-89ef-9d2c8d20dd82 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:43.668755 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e2c73-df3d-4d66-89ef-9d2c8d20dd82 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:43.669343 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e2c73-df3d-4d66-89ef-9d2c8d20dd82 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:43.670777 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e2c73-df3d-4d66-89ef-9d2c8d20dd82 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:43.680648 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-4f4e2c73-df3d-4d66-89ef-9d2c8d20dd82 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 23 00:43:43.680648 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:43.680648 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:43:43.680648 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:43:43.680648 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:43:43.680648 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:43:43.680648 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:43:43.680648 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:43:43.680648 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 23 00:43:43.680648 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:43.680648 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:43:43.680648 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:43.680648 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:43.680648 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:43.680648 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:43.680648 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:43.680648 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:43.681712 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:43.681712 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:43.681712 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:43.681712 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:43.681712 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:43.681712 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:43.681712 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:43:43.681712 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:43:43.681712 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:43:43.681712 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:43:43.681712 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:43.681712 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:43.681712 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:43.681712 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:43.681712 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:43.681712 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:43.682595 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:43.682595 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:43.682595 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:43.682595 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:43.682595 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:43.682595 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:43.682595 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:43.682595 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:43.682595 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:43.682595 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:43.682595 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:43:43.682595 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:43:43.682595 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 23 00:43:43.682595 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:43.682595 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 372/729] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 23 00:43:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:43.687866 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e4a69-fad5-484b-add8-b470909c3ea6 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:43.760277 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e2c73-df3d-4d66-89ef-9d2c8d20dd82 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:43.806560 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e4a69-fad5-484b-add8-b470909c3ea6 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:43.848231 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9575e5-4a47-4d6f-8cee-85a2b5aba01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:43.849167 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9575e5-4a47-4d6f-8cee-85a2b5aba01a None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:43.849680 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9575e5-4a47-4d6f-8cee-85a2b5aba01a None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:43.850181 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9575e5-4a47-4d6f-8cee-85a2b5aba01a None admin] PATH_INFO: `/v3/services` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:43.851066 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9575e5-4a47-4d6f-8cee-85a2b5aba01a None admin] RBAC: Adding query filter params (name=compute) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:43.851554 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9575e5-4a47-4d6f-8cee-85a2b5aba01a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:43.853777 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9575e5-4a47-4d6f-8cee-85a2b5aba01a None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:43.861129 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 358/730] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Oct 23 00:43:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:43.867193 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9575e5-4a47-4d6f-8cee-85a2b5aba01a None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:43.883918 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e2c73-df3d-4d66-89ef-9d2c8d20dd82 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:43.894388 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:43.931466 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a6a62-c640-4930-9cac-dad086e618f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:43.932482 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a6a62-c640-4930-9cac-dad086e618f5 None admin] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:43.932786 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a6a62-c640-4930-9cac-dad086e618f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:43.933062 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a6a62-c640-4930-9cac-dad086e618f5 None admin] PATH_INFO: `/v3/services` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:43.933737 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a6a62-c640-4930-9cac-dad086e618f5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:43.935456 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a6a62-c640-4930-9cac-dad086e618f5 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:43.937140 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:43.963155 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 373/731] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Oct 23 00:43:43 2022] POST /identity/v3/services => generated 242 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:43:44.009534 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9575e5-4a47-4d6f-8cee-85a2b5aba01a None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:44.057523 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a7c7d-a2e3-4518-9bb3-b24aefe6d978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:44.058068 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a7c7d-a2e3-4518-9bb3-b24aefe6d978 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:44.058379 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a7c7d-a2e3-4518-9bb3-b24aefe6d978 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:44.058653 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a7c7d-a2e3-4518-9bb3-b24aefe6d978 None admin] PATH_INFO: `/v3/services` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:44.059307 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310a7c7d-a2e3-4518-9bb3-b24aefe6d978 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:44.059610 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310a7c7d-a2e3-4518-9bb3-b24aefe6d978 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:44.061020 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310a7c7d-a2e3-4518-9bb3-b24aefe6d978 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:44.067460 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 359/732] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Oct 23 00:43:43 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:45.653222 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e43656-f4cc-4f67-b865-912babb588ca None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:45.654310 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e43656-f4cc-4f67-b865-912babb588ca None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:45.654801 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e43656-f4cc-4f67-b865-912babb588ca None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:45.656592 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 374/733] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:43:45.662305 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0dcf4f-3d2a-4623-b912-26faf584d11e None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:45.663105 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0dcf4f-3d2a-4623-b912-26faf584d11e None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:45.663579 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0dcf4f-3d2a-4623-b912-26faf584d11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:45.682819 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-5f0dcf4f-3d2a-4623-b912-26faf584d11e None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:45.684310 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-5f0dcf4f-3d2a-4623-b912-26faf584d11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:45.765519 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 360/734] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:45 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 00:43:45.848984 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2f76e-6862-4fc7-8a50-9facd90bc6d5 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:45.849320 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2f76e-6862-4fc7-8a50-9facd90bc6d5 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:45.849527 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2f76e-6862-4fc7-8a50-9facd90bc6d5 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:45.851429 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 375/735] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:43:45.856911 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71108927-6682-4d8f-a678-a11c2001237b None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:45.857187 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71108927-6682-4d8f-a678-a11c2001237b None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:45.857671 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71108927-6682-4d8f-a678-a11c2001237b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:45.877093 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-71108927-6682-4d8f-a678-a11c2001237b None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:45.878619 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-71108927-6682-4d8f-a678-a11c2001237b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:45.914802 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:45.950323 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 361/736] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:45 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:43:46.048161 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2f76e-6862-4fc7-8a50-9facd90bc6d5 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:46.169534 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2f76e-6862-4fc7-8a50-9facd90bc6d5 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:46.205931 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960936f2-1c13-4c77-95ff-9e1e5aba9740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:46.206450 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960936f2-1c13-4c77-95ff-9e1e5aba9740 None admin] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:46.206734 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960936f2-1c13-4c77-95ff-9e1e5aba9740 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:46.207011 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960936f2-1c13-4c77-95ff-9e1e5aba9740 None admin] PATH_INFO: `/v3/projects` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:46.208217 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960936f2-1c13-4c77-95ff-9e1e5aba9740 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:46.209252 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd859b-9e93-4d61-992f-e3a1f726acd1 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:46.209737 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960936f2-1c13-4c77-95ff-9e1e5aba9740 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:46.209938 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd859b-9e93-4d61-992f-e3a1f726acd1 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:46.210412 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd859b-9e93-4d61-992f-e3a1f726acd1 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:46.212153 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 362/737] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:43:46.216410 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: WARNING keystone.server.flask.common [None req-960936f2-1c13-4c77-95ff-9e1e5aba9740 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 23 00:43:46.217803 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8eae7b-f6aa-4de6-bfb9-4e948c5c02fb None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:46.218329 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8eae7b-f6aa-4de6-bfb9-4e948c5c02fb None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:46.218814 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8eae7b-f6aa-4de6-bfb9-4e948c5c02fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:46.233785 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.sql.core [None req-960936f2-1c13-4c77-95ff-9e1e5aba9740 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 23 00:43:46.233785 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 23 00:43:46.233785 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [parameters: {'id': 'd730f573628b49f482f8ea9ba4a930f0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 23 00:43:46.233785 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81359) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 23 00:43:46.241504 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-960936f2-1c13-4c77-95ff-9e1e5aba9740 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d730f573628b49f482f8ea9ba4a930f0.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d730f573628b49f482f8ea9ba4a930f0. Oct 23 00:43:46.241504 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:46.241504 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 23 00:43:46.241504 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 23 00:43:46.241504 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 23 00:43:46.241504 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 23 00:43:46.241504 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 23 00:43:46.241504 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application result = self._query(query) Oct 23 00:43:46.241504 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 23 00:43:46.241504 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application conn.query(q) Oct 23 00:43:46.241504 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 23 00:43:46.241504 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 23 00:43:46.241504 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 23 00:43:46.242335 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application result.read() Oct 23 00:43:46.242335 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 23 00:43:46.242335 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 23 00:43:46.242335 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 23 00:43:46.242335 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 23 00:43:46.242335 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 23 00:43:46.242335 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 23 00:43:46.242335 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 23 00:43:46.242335 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 23 00:43:46.242335 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 23 00:43:46.242335 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:46.242335 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 23 00:43:46.242335 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:46.242335 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:46.242335 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 23 00:43:46.242335 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 23 00:43:46.242335 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 23 00:43:46.242335 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 23 00:43:46.243270 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 23 00:43:46.243270 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application next(self.gen) Oct 23 00:43:46.243270 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 23 00:43:46.243270 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application yield resource Oct 23 00:43:46.243270 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 23 00:43:46.243270 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application next(self.gen) Oct 23 00:43:46.243270 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 23 00:43:46.243270 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application self.session.rollback() Oct 23 00:43:46.243270 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 00:43:46.243270 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application self.force_reraise() Oct 23 00:43:46.243270 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 00:43:46.243270 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise self.value Oct 23 00:43:46.243270 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 23 00:43:46.243270 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 23 00:43:46.243270 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 23 00:43:46.243270 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application session.commit() Oct 23 00:43:46.243270 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 23 00:43:46.244170 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 23 00:43:46.244170 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 23 00:43:46.244170 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application self._prepare_impl() Oct 23 00:43:46.244170 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 23 00:43:46.244170 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application self.session.flush() Oct 23 00:43:46.244170 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 23 00:43:46.244170 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application self._flush(objects) Oct 23 00:43:46.244170 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 23 00:43:46.244170 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 23 00:43:46.244170 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 23 00:43:46.244170 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application compat.raise_( Oct 23 00:43:46.244170 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 00:43:46.244170 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception Oct 23 00:43:46.244170 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 23 00:43:46.244170 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application flush_context.execute() Oct 23 00:43:46.244170 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 23 00:43:46.244170 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rec.execute(self) Oct 23 00:43:46.245071 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 23 00:43:46.245071 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 23 00:43:46.245071 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 23 00:43:46.245071 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 23 00:43:46.245071 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 23 00:43:46.245071 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 23 00:43:46.245071 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 23 00:43:46.245071 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 23 00:43:46.245071 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 23 00:43:46.245071 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 23 00:43:46.245071 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 23 00:43:46.245071 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 23 00:43:46.245071 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 23 00:43:46.245071 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 23 00:43:46.245071 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 23 00:43:46.245888 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 23 00:43:46.245888 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 00:43:46.245888 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception Oct 23 00:43:46.245888 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 23 00:43:46.245888 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 23 00:43:46.245888 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 23 00:43:46.245888 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 23 00:43:46.245888 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 23 00:43:46.245888 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application result = self._query(query) Oct 23 00:43:46.245888 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 23 00:43:46.245888 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application conn.query(q) Oct 23 00:43:46.245888 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 23 00:43:46.245888 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 23 00:43:46.245888 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 23 00:43:46.245888 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application result.read() Oct 23 00:43:46.245888 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 23 00:43:46.245888 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 23 00:43:46.246819 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 23 00:43:46.246819 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 23 00:43:46.246819 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 23 00:43:46.246819 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 23 00:43:46.246819 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 23 00:43:46.246819 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 23 00:43:46.246819 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 23 00:43:46.246819 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 23 00:43:46.246819 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [parameters: {'id': 'd730f573628b49f482f8ea9ba4a930f0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 23 00:43:46.246819 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 23 00:43:46.246819 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:46.246819 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:43:46.246819 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:46.246819 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:46.246819 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 23 00:43:46.248114 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 23 00:43:46.248114 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 23 00:43:46.248114 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 23 00:43:46.248114 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 23 00:43:46.248114 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:46.248114 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:43:46.248114 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:46.248114 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:46.248114 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:46.248114 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:46.248114 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:46.248114 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:46.248114 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:46.248114 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:46.248114 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:46.248114 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:46.248114 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:46.251087 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:46.251087 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 23 00:43:46.251087 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 23 00:43:46.251087 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:46.251087 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:46.251087 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 23 00:43:46.251087 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 23 00:43:46.251087 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d730f573628b49f482f8ea9ba4a930f0. Oct 23 00:43:46.251087 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:46.251700 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-1f8eae7b-f6aa-4de6-bfb9-4e948c5c02fb None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:46.251700 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-1f8eae7b-f6aa-4de6-bfb9-4e948c5c02fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:46.251867 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 376/738] 10.222.0.23 () {60 vars in 1140 bytes} [Sun Oct 23 00:43:46 2022] POST /identity/v3/projects => generated 262 bytes in 201 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:46.251867 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960936f2-1c13-4c77-95ff-9e1e5aba9740 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:46.278639 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:46.313847 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 363/739] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:46 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:43:46.315254 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13703542-b542-4c6f-a7a9-74700c93fec5 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:46.315550 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13703542-b542-4c6f-a7a9-74700c93fec5 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:46.315894 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13703542-b542-4c6f-a7a9-74700c93fec5 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:46.317898 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 364/740] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:43:46.318346 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13703542-b542-4c6f-a7a9-74700c93fec5 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:46.357973 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960936f2-1c13-4c77-95ff-9e1e5aba9740 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:46.392649 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc6c0e1-808e-4d32-8989-42e818a3d622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:46.393275 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6c0e1-808e-4d32-8989-42e818a3d622 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:46.393556 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6c0e1-808e-4d32-8989-42e818a3d622 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:46.393826 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6c0e1-808e-4d32-8989-42e818a3d622 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:46.394440 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc6c0e1-808e-4d32-8989-42e818a3d622 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:46.396500 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc6c0e1-808e-4d32-8989-42e818a3d622 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:46.405182 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-1fc6c0e1-808e-4d32-8989-42e818a3d622 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 00:43:46.405182 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:46.405182 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:43:46.405182 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:43:46.405182 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:43:46.405182 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:43:46.405182 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:43:46.405182 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:43:46.405182 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 00:43:46.405182 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:46.405182 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:43:46.405182 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:46.405182 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:46.405182 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:46.405182 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:46.405182 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:46.405182 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:46.406190 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:46.406190 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:46.406190 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:46.406190 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:46.406190 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:46.406190 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:46.406190 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:43:46.406190 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:43:46.406190 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:43:46.406190 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:43:46.406190 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:46.406190 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:46.406190 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:46.406190 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:46.406190 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:46.406190 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:46.407044 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:46.407044 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:46.407044 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:46.407044 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:46.407044 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:46.407044 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:46.407044 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:46.407044 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:46.407044 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:46.407044 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:46.407044 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:43:46.407044 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:43:46.407044 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 00:43:46.407044 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:46.407044 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 377/741] 10.222.0.23 () {56 vars in 1126 bytes} [Sun Oct 23 00:43:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:46.407842 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad73de5-bf1c-4158-b251-2ea6984470c2 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:46.407842 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad73de5-bf1c-4158-b251-2ea6984470c2 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:46.408505 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad73de5-bf1c-4158-b251-2ea6984470c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:46.427253 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-3ad73de5-bf1c-4158-b251-2ea6984470c2 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:46.428692 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-3ad73de5-bf1c-4158-b251-2ea6984470c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:46.430386 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:46.436224 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13703542-b542-4c6f-a7a9-74700c93fec5 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:46.473975 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c891db7-a448-4fcd-a050-0b06213a5149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:46.474637 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c891db7-a448-4fcd-a050-0b06213a5149 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:46.474970 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c891db7-a448-4fcd-a050-0b06213a5149 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:46.475317 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c891db7-a448-4fcd-a050-0b06213a5149 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:46.482876 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c891db7-a448-4fcd-a050-0b06213a5149 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:46.484314 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c891db7-a448-4fcd-a050-0b06213a5149 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:46.495996 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-0c891db7-a448-4fcd-a050-0b06213a5149 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:43:46.495996 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:46.495996 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:46.495996 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:46.495996 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:46.495996 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:46.495996 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:46.495996 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:46.495996 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:46.495996 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:46.495996 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:46.495996 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:46.495996 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 00:43:46.495996 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 00:43:46.495996 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 00:43:46.496899 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 00:43:46.496899 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:46.496899 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:46.496899 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:46.496899 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:46.496899 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:46.496899 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:46.496899 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:46.496899 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:46.496899 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:46.496899 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:46.496899 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:46.496899 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:46.496899 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:46.496899 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:46.496899 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:46.496899 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:46.498400 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 00:43:46.498400 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 00:43:46.498400 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 00:43:46.498400 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 00:43:46.498400 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 00:43:46.498400 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 00:43:46.498400 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:43:46.498400 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:46.498400 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 365/742] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 23 00:43:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:46.498400 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c891db7-a448-4fcd-a050-0b06213a5149 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:46.510116 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 378/743] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:46 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:43:46.510116 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad73de5-bf1c-4158-b251-2ea6984470c2 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:46.527332 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:46.616548 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c891db7-a448-4fcd-a050-0b06213a5149 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:46.636954 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad73de5-bf1c-4158-b251-2ea6984470c2 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:46.653780 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d552920c-76ab-4192-a12a-71644d6f49f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:46.654521 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552920c-76ab-4192-a12a-71644d6f49f6 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:46.654804 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552920c-76ab-4192-a12a-71644d6f49f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:46.655079 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552920c-76ab-4192-a12a-71644d6f49f6 None admin] PATH_INFO: `/v3/services` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:46.655701 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d552920c-76ab-4192-a12a-71644d6f49f6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:46.656009 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d552920c-76ab-4192-a12a-71644d6f49f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:46.657475 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d552920c-76ab-4192-a12a-71644d6f49f6 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:46.667223 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 366/744] 10.222.0.23 () {56 vars in 1122 bytes} [Sun Oct 23 00:43:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:46.667223 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d552920c-76ab-4192-a12a-71644d6f49f6 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:46.679502 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cf8e52-7ed1-48df-9626-d12622f703bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:46.680320 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf8e52-7ed1-48df-9626-d12622f703bd None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:46.680632 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf8e52-7ed1-48df-9626-d12622f703bd None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:46.680903 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf8e52-7ed1-48df-9626-d12622f703bd None admin] PATH_INFO: `/v3/projects` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:46.681562 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cf8e52-7ed1-48df-9626-d12622f703bd None admin] RBAC: Adding query filter params (name=service) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:46.681865 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cf8e52-7ed1-48df-9626-d12622f703bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:46.683778 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cf8e52-7ed1-48df-9626-d12622f703bd None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:46.689775 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:46.713776 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 379/745] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Oct 23 00:43:46 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:46.713776 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cf8e52-7ed1-48df-9626-d12622f703bd None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:46.794271 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d552920c-76ab-4192-a12a-71644d6f49f6 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:46.812204 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:46.833777 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad47e4-6d55-4e56-90f4-9eb29f90027f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:46.834443 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad47e4-6d55-4e56-90f4-9eb29f90027f None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:46.834726 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad47e4-6d55-4e56-90f4-9eb29f90027f None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:46.834989 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad47e4-6d55-4e56-90f4-9eb29f90027f None admin] PATH_INFO: `/v3/services/image` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:46.835602 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad47e4-6d55-4e56-90f4-9eb29f90027f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:46.837140 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad47e4-6d55-4e56-90f4-9eb29f90027f None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:46.839019 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cf8e52-7ed1-48df-9626-d12622f703bd None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:46.848037 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-48ad47e4-6d55-4e56-90f4-9eb29f90027f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 23 00:43:46.848037 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:46.848037 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:43:46.848037 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:43:46.848037 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:43:46.848037 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:43:46.848037 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:43:46.848037 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:43:46.848037 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 23 00:43:46.848037 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:46.848037 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:43:46.848037 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:46.848037 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:46.848037 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:46.848037 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:46.848037 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:46.848037 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:46.849106 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:46.849106 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:46.849106 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:46.849106 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:46.849106 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:46.849106 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:46.849106 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:43:46.849106 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:43:46.849106 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:43:46.849106 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:43:46.849106 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:46.849106 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:46.849106 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:46.849106 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:46.849106 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:46.849106 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:46.849930 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:46.849930 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:46.849930 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:46.849930 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:46.849930 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:46.849930 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:46.849930 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:46.849930 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:46.849930 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:46.849930 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:46.849930 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:43:46.849930 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:43:46.849930 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 23 00:43:46.849930 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:46.849930 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 367/746] 10.222.0.23 () {56 vars in 1105 bytes} [Sun Oct 23 00:43:46 2022] GET /identity/v3/services/image => generated 86 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:46.851375 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad47e4-6d55-4e56-90f4-9eb29f90027f None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:46.885362 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675400ca-997f-453a-a59e-e136e2a6a7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:46.886313 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675400ca-997f-453a-a59e-e136e2a6a7b9 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:46.886775 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675400ca-997f-453a-a59e-e136e2a6a7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:46.887207 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675400ca-997f-453a-a59e-e136e2a6a7b9 None admin] PATH_INFO: `/v3/services` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:46.887847 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675400ca-997f-453a-a59e-e136e2a6a7b9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:46.888156 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675400ca-997f-453a-a59e-e136e2a6a7b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:46.890043 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675400ca-997f-453a-a59e-e136e2a6a7b9 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:46.894798 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 380/747] 10.222.0.23 () {56 vars in 1122 bytes} [Sun Oct 23 00:43:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:46.898228 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675400ca-997f-453a-a59e-e136e2a6a7b9 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:46.956497 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:46.971355 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad47e4-6d55-4e56-90f4-9eb29f90027f None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:47.008660 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681adfa-1fc0-4b1a-8800-47f5c5ba39d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:47.009271 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681adfa-1fc0-4b1a-8800-47f5c5ba39d1 None admin] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:47.009379 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675400ca-997f-453a-a59e-e136e2a6a7b9 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:47.009562 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681adfa-1fc0-4b1a-8800-47f5c5ba39d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:47.009819 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681adfa-1fc0-4b1a-8800-47f5c5ba39d1 None admin] PATH_INFO: `/v3/services` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:47.010506 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2681adfa-1fc0-4b1a-8800-47f5c5ba39d1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:47.012373 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2681adfa-1fc0-4b1a-8800-47f5c5ba39d1 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:47.029517 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 368/748] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Oct 23 00:43:46 2022] POST /identity/v3/services => generated 242 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:43:47.030211 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681adfa-1fc0-4b1a-8800-47f5c5ba39d1 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:47.069886 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73b967-978e-4794-94e7-c72fdc17c79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:47.070922 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73b967-978e-4794-94e7-c72fdc17c79b None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:47.071385 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73b967-978e-4794-94e7-c72fdc17c79b None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:47.071810 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73b967-978e-4794-94e7-c72fdc17c79b None admin] PATH_INFO: `/v3/services` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:47.072610 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc73b967-978e-4794-94e7-c72fdc17c79b None admin] RBAC: Adding query filter params (name=image) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:47.073332 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc73b967-978e-4794-94e7-c72fdc17c79b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:47.076134 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc73b967-978e-4794-94e7-c72fdc17c79b None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:47.078576 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:47.084411 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 381/749] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:43:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:47.092519 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73b967-978e-4794-94e7-c72fdc17c79b None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:47.156315 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681adfa-1fc0-4b1a-8800-47f5c5ba39d1 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:47.202023 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88591f-1a5c-408f-8f9c-9153891d67e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:47.203073 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88591f-1a5c-408f-8f9c-9153891d67e3 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:47.203426 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88591f-1a5c-408f-8f9c-9153891d67e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:47.203773 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88591f-1a5c-408f-8f9c-9153891d67e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:47.204757 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b88591f-1a5c-408f-8f9c-9153891d67e3 None admin] RBAC: Adding query filter params (interface=admin, service_id=6852bb5ba5ff482797e3b89caf444edb, region_id=RegionOne) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:47.205980 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b88591f-1a5c-408f-8f9c-9153891d67e3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:47.207592 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b88591f-1a5c-408f-8f9c-9153891d67e3 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:47.214302 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 369/750] 10.222.0.23 () {56 vars in 1249 bytes} [Sun Oct 23 00:43:47 2022] GET /identity/v3/endpoints?service_id=6852bb5ba5ff482797e3b89caf444edb&interface=admin®ion_id=RegionOne => generated 193 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:47.220154 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88591f-1a5c-408f-8f9c-9153891d67e3 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:47.244315 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:47.258455 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73b967-978e-4794-94e7-c72fdc17c79b None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:47.300243 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab0f6a7-2ae7-4a81-9afe-4ae544329fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:47.302209 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0f6a7-2ae7-4a81-9afe-4ae544329fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:47.302643 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0f6a7-2ae7-4a81-9afe-4ae544329fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:47.303361 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0f6a7-2ae7-4a81-9afe-4ae544329fd9 None admin] PATH_INFO: `/v3/services` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:47.304393 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab0f6a7-2ae7-4a81-9afe-4ae544329fd9 None admin] RBAC: Adding query filter params (type=image) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:47.304944 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab0f6a7-2ae7-4a81-9afe-4ae544329fd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:47.307149 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab0f6a7-2ae7-4a81-9afe-4ae544329fd9 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:47.314955 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 382/751] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:43:47 2022] GET /identity/v3/services?type=image => generated 350 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:47.322133 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab0f6a7-2ae7-4a81-9afe-4ae544329fd9 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:47.358920 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88591f-1a5c-408f-8f9c-9153891d67e3 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:47.404355 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ff056-8c4a-40f0-98e9-2cc45b593631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:47.405049 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ff056-8c4a-40f0-98e9-2cc45b593631 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:47.405555 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ff056-8c4a-40f0-98e9-2cc45b593631 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:47.406397 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ff056-8c4a-40f0-98e9-2cc45b593631 None admin] PATH_INFO: `/v3/services` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:47.407478 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ff056-8c4a-40f0-98e9-2cc45b593631 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:47.408388 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:47.411266 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ff056-8c4a-40f0-98e9-2cc45b593631 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:47.422002 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 370/752] 10.222.0.23 () {56 vars in 1087 bytes} [Sun Oct 23 00:43:47 2022] GET /identity/v3/services => generated 1957 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:43:47.458057 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab0f6a7-2ae7-4a81-9afe-4ae544329fd9 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:47.498782 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd60cfc1-3652-4ba9-8035-83f1afa3beae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:47.499576 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60cfc1-3652-4ba9-8035-83f1afa3beae None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:47.499948 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60cfc1-3652-4ba9-8035-83f1afa3beae None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:47.500322 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60cfc1-3652-4ba9-8035-83f1afa3beae None admin] PATH_INFO: `/v3/endpoints` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:47.501158 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd60cfc1-3652-4ba9-8035-83f1afa3beae None admin] RBAC: Adding query filter params (interface=public, service_id=6a3b6bb38d3a4173b6266a53268aa25e, region_id=RegionOne) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:47.501569 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd60cfc1-3652-4ba9-8035-83f1afa3beae None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:47.503146 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd60cfc1-3652-4ba9-8035-83f1afa3beae None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:47.514242 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 383/753] 10.222.0.23 () {56 vars in 1251 bytes} [Sun Oct 23 00:43:47 2022] GET /identity/v3/endpoints?service_id=6a3b6bb38d3a4173b6266a53268aa25e&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:43:47.516229 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ff056-8c4a-40f0-98e9-2cc45b593631 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:47.606323 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:47.631281 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ff056-8c4a-40f0-98e9-2cc45b593631 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:47.666466 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8811a8e3-c219-4493-9a91-53b820fa0a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:47.667359 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811a8e3-c219-4493-9a91-53b820fa0a4a None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:47.668224 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811a8e3-c219-4493-9a91-53b820fa0a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:47.668648 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811a8e3-c219-4493-9a91-53b820fa0a4a None admin] PATH_INFO: `/v3/services` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:47.669401 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8811a8e3-c219-4493-9a91-53b820fa0a4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:47.670937 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8811a8e3-c219-4493-9a91-53b820fa0a4a None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:47.678234 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 371/754] 10.222.0.23 () {56 vars in 1087 bytes} [Sun Oct 23 00:43:47 2022] GET /identity/v3/services => generated 1957 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:43:48.979446 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae62b45-0fa9-4876-bcbc-541d99c60ecd None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:48.980016 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae62b45-0fa9-4876-bcbc-541d99c60ecd None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:48.980016 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae62b45-0fa9-4876-bcbc-541d99c60ecd None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:48.981862 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 384/755] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:43:48.987219 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50a737-0c1b-49d1-8c5c-f3b23ff496d8 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:48.987611 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50a737-0c1b-49d1-8c5c-f3b23ff496d8 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:48.987780 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50a737-0c1b-49d1-8c5c-f3b23ff496d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:49.006680 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-0a50a737-0c1b-49d1-8c5c-f3b23ff496d8 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:49.007877 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-0a50a737-0c1b-49d1-8c5c-f3b23ff496d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:49.076986 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 372/756] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:48 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:43:49.289495 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6ed01-3137-49cd-9335-7c2c7b162ff8 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:49.289803 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6ed01-3137-49cd-9335-7c2c7b162ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:49.289971 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6ed01-3137-49cd-9335-7c2c7b162ff8 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:49.291649 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 385/757] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:43:49.296980 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c2f71-989e-4aec-b474-cd075fafbf71 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:49.297379 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c2f71-989e-4aec-b474-cd075fafbf71 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:49.297781 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c2f71-989e-4aec-b474-cd075fafbf71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:49.317239 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-0b6c2f71-989e-4aec-b474-cd075fafbf71 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:49.318461 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-0b6c2f71-989e-4aec-b474-cd075fafbf71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:49.361212 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae6ed01-3137-49cd-9335-7c2c7b162ff8 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:49.394143 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 373/758] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:49 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:43:49.394143 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:49.471807 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae6ed01-3137-49cd-9335-7c2c7b162ff8 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:49.499276 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:49.507805 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15bcef2-c7e7-4fad-a25c-fc99f64228a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:49.508434 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bcef2-c7e7-4fad-a25c-fc99f64228a7 None admin] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:49.508866 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bcef2-c7e7-4fad-a25c-fc99f64228a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:49.509150 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bcef2-c7e7-4fad-a25c-fc99f64228a7 None admin] PATH_INFO: `/v3/users` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:49.509816 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15bcef2-c7e7-4fad-a25c-fc99f64228a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:49.511328 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15bcef2-c7e7-4fad-a25c-fc99f64228a7 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:49.534798 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.sql.core [None req-e15bcef2-c7e7-4fad-a25c-fc99f64228a7 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 23 00:43:49.534798 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 23 00:43:49.534798 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [parameters: {'user_id': '7efde4600f5944fdbb1c07cf779dd383', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 23 00:43:49.534798 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81359) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 23 00:43:49.542753 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-e15bcef2-c7e7-4fad-a25c-fc99f64228a7 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 23 00:43:49.542753 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:49.542753 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 23 00:43:49.542753 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 23 00:43:49.542753 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 23 00:43:49.542753 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 23 00:43:49.542753 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 23 00:43:49.542753 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application result = self._query(query) Oct 23 00:43:49.542753 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 23 00:43:49.542753 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application conn.query(q) Oct 23 00:43:49.542753 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 23 00:43:49.542753 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 23 00:43:49.542753 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 23 00:43:49.542753 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application result.read() Oct 23 00:43:49.542753 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 23 00:43:49.543703 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 23 00:43:49.543703 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 23 00:43:49.543703 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 23 00:43:49.543703 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 23 00:43:49.543703 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 23 00:43:49.543703 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 23 00:43:49.543703 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 23 00:43:49.543703 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 23 00:43:49.543703 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:49.543703 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 23 00:43:49.543703 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:49.543703 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:49.543703 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 23 00:43:49.543703 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 23 00:43:49.543703 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 23 00:43:49.543703 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 23 00:43:49.543703 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 23 00:43:49.543703 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application next(self.gen) Oct 23 00:43:49.544622 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 23 00:43:49.544622 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application yield resource Oct 23 00:43:49.544622 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 23 00:43:49.544622 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application next(self.gen) Oct 23 00:43:49.544622 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 23 00:43:49.544622 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application self.session.rollback() Oct 23 00:43:49.544622 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 00:43:49.544622 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application self.force_reraise() Oct 23 00:43:49.544622 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 00:43:49.544622 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise self.value Oct 23 00:43:49.544622 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 23 00:43:49.544622 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 23 00:43:49.544622 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 23 00:43:49.544622 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application session.commit() Oct 23 00:43:49.544622 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 23 00:43:49.544622 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 23 00:43:49.544622 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 23 00:43:49.545485 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application self._prepare_impl() Oct 23 00:43:49.545485 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 23 00:43:49.545485 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application self.session.flush() Oct 23 00:43:49.545485 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 23 00:43:49.545485 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application self._flush(objects) Oct 23 00:43:49.545485 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 23 00:43:49.545485 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 23 00:43:49.545485 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 23 00:43:49.545485 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application compat.raise_( Oct 23 00:43:49.545485 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 00:43:49.545485 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception Oct 23 00:43:49.545485 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 23 00:43:49.545485 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application flush_context.execute() Oct 23 00:43:49.545485 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 23 00:43:49.545485 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rec.execute(self) Oct 23 00:43:49.545485 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 23 00:43:49.545485 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 23 00:43:49.546390 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 23 00:43:49.546390 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 23 00:43:49.546390 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 23 00:43:49.546390 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 23 00:43:49.546390 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 23 00:43:49.546390 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 23 00:43:49.546390 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 23 00:43:49.546390 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 23 00:43:49.546390 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 23 00:43:49.546390 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 23 00:43:49.546390 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 23 00:43:49.546390 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 23 00:43:49.546390 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 23 00:43:49.546390 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 23 00:43:49.546390 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 00:43:49.546390 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception Oct 23 00:43:49.547217 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 23 00:43:49.547217 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 23 00:43:49.547217 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 23 00:43:49.547217 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 23 00:43:49.547217 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 23 00:43:49.547217 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application result = self._query(query) Oct 23 00:43:49.547217 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 23 00:43:49.547217 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application conn.query(q) Oct 23 00:43:49.547217 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 23 00:43:49.547217 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 23 00:43:49.547217 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 23 00:43:49.547217 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application result.read() Oct 23 00:43:49.547217 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 23 00:43:49.547217 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 23 00:43:49.547217 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 23 00:43:49.547217 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 23 00:43:49.548027 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 23 00:43:49.548027 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 23 00:43:49.548027 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 23 00:43:49.548027 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 23 00:43:49.548027 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 23 00:43:49.548027 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 23 00:43:49.548027 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [parameters: {'user_id': '7efde4600f5944fdbb1c07cf779dd383', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 23 00:43:49.548027 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 23 00:43:49.548027 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:49.548027 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:43:49.548027 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:49.548027 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:49.548027 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:49.548027 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:49.548027 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:49.548831 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:49.548831 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:49.548831 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:49.548831 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:49.548831 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:49.548831 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:49.548831 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:49.548831 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 23 00:43:49.548831 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 23 00:43:49.548831 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:49.548831 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:49.548831 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:43:49.548831 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:43:49.548831 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:43:49.548831 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:43:49.548831 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 23 00:43:49.548831 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 23 00:43:49.549816 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 23 00:43:49.549816 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 23 00:43:49.549816 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 23 00:43:49.549816 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 23 00:43:49.549816 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 23 00:43:49.549816 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:49.549816 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 386/759] 10.222.0.23 () {60 vars in 1131 bytes} [Sun Oct 23 00:43:49 2022] POST /identity/v3/users => generated 160 bytes in 184 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:43:49.560640 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c2f71-989e-4aec-b474-cd075fafbf71 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:49.666878 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c2f71-989e-4aec-b474-cd075fafbf71 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:49.674341 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9a444-50c5-4f1e-a06d-7e254405fb15 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:49.674618 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9a444-50c5-4f1e-a06d-7e254405fb15 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:49.674899 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9a444-50c5-4f1e-a06d-7e254405fb15 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:49.679996 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 387/760] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:43:49.685808 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53161a-b5fa-48a0-965a-73b8498f3884 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:49.686125 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53161a-b5fa-48a0-965a-73b8498f3884 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:49.686410 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53161a-b5fa-48a0-965a-73b8498f3884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:49.704470 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9f90d-a942-472b-81ae-23ec0655ae72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:49.704789 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-6f53161a-b5fa-48a0-965a-73b8498f3884 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:49.705617 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9f90d-a942-472b-81ae-23ec0655ae72 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:49.706034 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9f90d-a942-472b-81ae-23ec0655ae72 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:49.706246 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-6f53161a-b5fa-48a0-965a-73b8498f3884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:49.706658 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9f90d-a942-472b-81ae-23ec0655ae72 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:49.714704 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd9f90d-a942-472b-81ae-23ec0655ae72 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:49.716470 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd9f90d-a942-472b-81ae-23ec0655ae72 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:49.729545 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-0bd9f90d-a942-472b-81ae-23ec0655ae72 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 23 00:43:49.729545 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:49.729545 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:49.729545 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:49.729545 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:49.729545 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:49.729545 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:49.729545 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:49.729545 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:49.729545 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:49.729545 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:49.729545 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:49.729545 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 00:43:49.729545 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 00:43:49.729545 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 00:43:49.729545 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 00:43:49.730712 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:49.730712 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:49.730712 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:43:49.730712 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:43:49.730712 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:43:49.730712 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:43:49.730712 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:49.730712 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:49.730712 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:49.730712 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:49.730712 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:49.730712 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:49.730712 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:49.730712 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:49.730712 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:49.730712 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:49.730712 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:49.730712 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:49.732149 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:49.732149 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:49.732149 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 00:43:49.732149 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 00:43:49.732149 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 00:43:49.732149 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 00:43:49.732149 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 00:43:49.732149 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 00:43:49.732149 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 23 00:43:49.732149 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:49.739614 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 374/761] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 23 00:43:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:49.740590 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9f90d-a942-472b-81ae-23ec0655ae72 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:49.779077 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 388/762] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:49 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:43:49.780048 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53161a-b5fa-48a0-965a-73b8498f3884 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:49.822634 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:49.873550 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9f90d-a942-472b-81ae-23ec0655ae72 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:49.894179 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53161a-b5fa-48a0-965a-73b8498f3884 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:49.914399 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d8382-3738-45b5-8e1e-1f7b299499d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:49.915014 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d8382-3738-45b5-8e1e-1f7b299499d3 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:49.915332 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d8382-3738-45b5-8e1e-1f7b299499d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:49.915554 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d8382-3738-45b5-8e1e-1f7b299499d3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:49.916252 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:49.916909 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d8382-3738-45b5-8e1e-1f7b299499d3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:49.918565 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d8382-3738-45b5-8e1e-1f7b299499d3 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:49.931309 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-da4d8382-3738-45b5-8e1e-1f7b299499d3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 23 00:43:49.931309 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:49.931309 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:43:49.931309 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:43:49.931309 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:43:49.931309 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:43:49.931309 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:43:49.931309 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:43:49.931309 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 23 00:43:49.931309 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:49.931309 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:43:49.931309 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:49.931309 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:49.931309 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:49.931309 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:49.931309 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:49.931309 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:49.932344 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:49.932344 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:49.932344 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:49.932344 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:49.932344 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:49.932344 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:49.932344 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:43:49.932344 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:43:49.932344 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:43:49.932344 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:43:49.932344 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:49.932344 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:49.932344 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:49.932344 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:49.932344 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:49.932344 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:49.933195 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:49.933195 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:49.933195 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:49.933195 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:49.933195 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:49.933195 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:49.933195 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:49.933195 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:49.933195 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:49.933195 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:49.933195 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:43:49.933195 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:43:49.933195 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 23 00:43:49.933195 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:49.933195 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 375/763] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 23 00:43:49 2022] GET /identity/v3/services/compute => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:49.933996 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ae91a-b3c2-478d-983e-f0afda21500d None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:49.933996 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ae91a-b3c2-478d-983e-f0afda21500d None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:49.934163 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ae91a-b3c2-478d-983e-f0afda21500d None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:49.935458 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 376/764] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:43:49.937348 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeebdb2a-9e30-42d0-ac72-41b84fb4ff05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:49.937991 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeebdb2a-9e30-42d0-ac72-41b84fb4ff05 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:49.938320 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeebdb2a-9e30-42d0-ac72-41b84fb4ff05 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:49.938622 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeebdb2a-9e30-42d0-ac72-41b84fb4ff05 None admin] PATH_INFO: `/v3/users` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:49.940273 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeebdb2a-9e30-42d0-ac72-41b84fb4ff05 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:49.940623 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeebdb2a-9e30-42d0-ac72-41b84fb4ff05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:49.940779 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1445f8a-1e62-4dae-bb59-f9baab913c1f None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:49.940987 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1445f8a-1e62-4dae-bb59-f9baab913c1f None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:49.941274 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1445f8a-1e62-4dae-bb59-f9baab913c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:49.942276 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeebdb2a-9e30-42d0-ac72-41b84fb4ff05 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:49.960437 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-b1445f8a-1e62-4dae-bb59-f9baab913c1f None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:49.961636 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-b1445f8a-1e62-4dae-bb59-f9baab913c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:49.980279 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 389/765] 10.222.0.23 () {56 vars in 1101 bytes} [Sun Oct 23 00:43:49 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:49.981951 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeebdb2a-9e30-42d0-ac72-41b84fb4ff05 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:50.055362 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 377/766] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:49 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 00:43:50.056926 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1445f8a-1e62-4dae-bb59-f9baab913c1f None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:50.115992 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeebdb2a-9e30-42d0-ac72-41b84fb4ff05 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:50.128021 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:50.166665 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e0f748-c388-4713-94da-ccb82d34ab7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:50.167734 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0f748-c388-4713-94da-ccb82d34ab7a None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:50.168021 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0f748-c388-4713-94da-ccb82d34ab7a None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:50.168448 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0f748-c388-4713-94da-ccb82d34ab7a None admin] PATH_INFO: `/v3/services` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:50.169093 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e0f748-c388-4713-94da-ccb82d34ab7a None admin] RBAC: Adding query filter params (name=compute) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:50.171568 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e0f748-c388-4713-94da-ccb82d34ab7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:50.171568 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e0f748-c388-4713-94da-ccb82d34ab7a None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:50.179479 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 390/767] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Oct 23 00:43:49 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:50.183356 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1445f8a-1e62-4dae-bb59-f9baab913c1f None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:50.185237 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e0f748-c388-4713-94da-ccb82d34ab7a None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:50.233493 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c409252-2c4a-4294-b857-f42edf1cb29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:50.234286 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c409252-2c4a-4294-b857-f42edf1cb29c None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:50.234635 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c409252-2c4a-4294-b857-f42edf1cb29c None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:50.234978 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c409252-2c4a-4294-b857-f42edf1cb29c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:50.235640 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c409252-2c4a-4294-b857-f42edf1cb29c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:50.237621 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c409252-2c4a-4294-b857-f42edf1cb29c None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:50.241814 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:50.248921 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-8c409252-2c4a-4294-b857-f42edf1cb29c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 00:43:50.248921 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:50.248921 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:43:50.248921 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:43:50.248921 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:43:50.248921 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:43:50.248921 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:43:50.248921 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:43:50.248921 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 00:43:50.248921 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:50.248921 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:43:50.248921 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:50.248921 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:50.248921 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:50.248921 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:50.248921 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:50.248921 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:50.249944 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:50.249944 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:50.249944 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:50.249944 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:50.249944 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:50.249944 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:50.249944 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:43:50.249944 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:43:50.249944 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:43:50.249944 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:43:50.249944 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:50.249944 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:50.249944 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:50.249944 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:50.249944 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:50.249944 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:50.251384 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:50.251384 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:50.251384 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:50.251384 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:50.251384 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:50.251384 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:50.251384 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:50.251384 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:50.251384 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:50.251384 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:50.251384 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:43:50.251384 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:43:50.251384 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 23 00:43:50.251384 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:50.251384 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 378/768] 10.222.0.23 () {56 vars in 1126 bytes} [Sun Oct 23 00:43:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:50.258189 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c409252-2c4a-4294-b857-f42edf1cb29c None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:50.320030 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e0f748-c388-4713-94da-ccb82d34ab7a None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:50.355888 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59565f86-c97c-4c78-9b0d-af1c5fb379c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:50.356759 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59565f86-c97c-4c78-9b0d-af1c5fb379c0 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:50.357040 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59565f86-c97c-4c78-9b0d-af1c5fb379c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:50.357315 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59565f86-c97c-4c78-9b0d-af1c5fb379c0 None admin] PATH_INFO: `/v3/services` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:50.357945 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59565f86-c97c-4c78-9b0d-af1c5fb379c0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:50.358278 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59565f86-c97c-4c78-9b0d-af1c5fb379c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:50.359653 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59565f86-c97c-4c78-9b0d-af1c5fb379c0 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:50.364491 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 391/769] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Oct 23 00:43:50 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:50.365258 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59565f86-c97c-4c78-9b0d-af1c5fb379c0 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:50.379377 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c409252-2c4a-4294-b857-f42edf1cb29c None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:50.397412 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:50.414487 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd0df7-6209-4ec3-8fc7-ae9a653f4803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:50.415081 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd0df7-6209-4ec3-8fc7-ae9a653f4803 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:50.415358 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd0df7-6209-4ec3-8fc7-ae9a653f4803 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:50.415630 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd0df7-6209-4ec3-8fc7-ae9a653f4803 None admin] PATH_INFO: `/v3/services` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:50.416251 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd0df7-6209-4ec3-8fc7-ae9a653f4803 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:50.416550 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd0df7-6209-4ec3-8fc7-ae9a653f4803 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:50.417906 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd0df7-6209-4ec3-8fc7-ae9a653f4803 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:50.422711 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 379/770] 10.222.0.23 () {56 vars in 1122 bytes} [Sun Oct 23 00:43:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:43:50.423472 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd0df7-6209-4ec3-8fc7-ae9a653f4803 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:50.466023 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59565f86-c97c-4c78-9b0d-af1c5fb379c0 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:50.473997 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:50.500938 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41041885-3760-4109-bc1b-7d6df8b8c334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:50.501560 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41041885-3760-4109-bc1b-7d6df8b8c334 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:50.501841 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41041885-3760-4109-bc1b-7d6df8b8c334 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:50.502142 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41041885-3760-4109-bc1b-7d6df8b8c334 None admin] PATH_INFO: `/v3/services/image` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:50.502724 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41041885-3760-4109-bc1b-7d6df8b8c334 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:50.504127 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41041885-3760-4109-bc1b-7d6df8b8c334 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:50.512796 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-41041885-3760-4109-bc1b-7d6df8b8c334 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 23 00:43:50.512796 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:50.512796 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:43:50.512796 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:43:50.512796 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:43:50.512796 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:43:50.512796 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:43:50.512796 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:43:50.512796 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 23 00:43:50.512796 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:50.512796 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:43:50.512796 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:50.512796 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:50.512796 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:50.512796 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:50.512796 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:50.512796 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:50.513947 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:50.513947 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:50.513947 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:50.513947 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:50.513947 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:50.513947 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:50.513947 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:43:50.513947 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:43:50.513947 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:43:50.513947 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:43:50.513947 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:50.513947 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:50.513947 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:50.513947 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:50.513947 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:50.513947 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:50.514853 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:50.514853 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:50.514853 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:50.514853 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:50.514853 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:50.514853 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:50.514853 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:50.514853 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:50.514853 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:50.514853 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:50.514853 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:43:50.514853 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:43:50.514853 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 23 00:43:50.514853 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:50.514853 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 392/771] 10.222.0.23 () {56 vars in 1105 bytes} [Sun Oct 23 00:43:50 2022] GET /identity/v3/services/image => generated 86 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:50.515650 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41041885-3760-4109-bc1b-7d6df8b8c334 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:50.525367 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd0df7-6209-4ec3-8fc7-ae9a653f4803 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:50.560417 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f8a59-4330-48d2-86c5-2f25ce113f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:50.561014 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f8a59-4330-48d2-86c5-2f25ce113f50 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:50.561294 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f8a59-4330-48d2-86c5-2f25ce113f50 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:50.561571 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f8a59-4330-48d2-86c5-2f25ce113f50 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:50.562298 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f8a59-4330-48d2-86c5-2f25ce113f50 None admin] RBAC: Adding query filter params (interface=public, service_id=dfc6c63f9f6946b08cac03917bc16980, region_id=RegionOne) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:50.562603 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f8a59-4330-48d2-86c5-2f25ce113f50 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:50.563961 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f8a59-4330-48d2-86c5-2f25ce113f50 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:50.573362 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 380/772] 10.222.0.23 () {56 vars in 1251 bytes} [Sun Oct 23 00:43:50 2022] GET /identity/v3/endpoints?service_id=dfc6c63f9f6946b08cac03917bc16980&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:50.573362 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f8a59-4330-48d2-86c5-2f25ce113f50 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:50.614563 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41041885-3760-4109-bc1b-7d6df8b8c334 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:50.618553 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:50.648076 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0158d-019d-49eb-840f-a5e1a4c13142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:50.648613 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0158d-019d-49eb-840f-a5e1a4c13142 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:50.648894 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0158d-019d-49eb-840f-a5e1a4c13142 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:50.649167 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0158d-019d-49eb-840f-a5e1a4c13142 None admin] PATH_INFO: `/v3/services` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:50.649798 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad0158d-019d-49eb-840f-a5e1a4c13142 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:50.650130 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad0158d-019d-49eb-840f-a5e1a4c13142 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:50.651530 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad0158d-019d-49eb-840f-a5e1a4c13142 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:50.656324 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 393/773] 10.222.0.23 () {56 vars in 1122 bytes} [Sun Oct 23 00:43:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:50.657096 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0158d-019d-49eb-840f-a5e1a4c13142 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:50.677404 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f8a59-4330-48d2-86c5-2f25ce113f50 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:50.690563 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:50.712426 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52841bae-1949-42e9-b556-209739905728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:50.713023 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52841bae-1949-42e9-b556-209739905728 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:50.713305 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52841bae-1949-42e9-b556-209739905728 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:50.713577 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52841bae-1949-42e9-b556-209739905728 None admin] PATH_INFO: `/v3/services` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:50.714238 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52841bae-1949-42e9-b556-209739905728 None admin] RBAC: Adding query filter params (name=image) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:50.714542 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52841bae-1949-42e9-b556-209739905728 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:50.715904 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52841bae-1949-42e9-b556-209739905728 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:50.720668 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 381/774] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:43:50 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:50.721419 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52841bae-1949-42e9-b556-209739905728 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:50.759791 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0158d-019d-49eb-840f-a5e1a4c13142 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:50.793378 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d7ed0c-7cbd-49be-948b-3ca948145040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:50.793985 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7ed0c-7cbd-49be-948b-3ca948145040 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:50.794294 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7ed0c-7cbd-49be-948b-3ca948145040 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:50.794575 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7ed0c-7cbd-49be-948b-3ca948145040 None admin] PATH_INFO: `/v3/services` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:50.795184 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d7ed0c-7cbd-49be-948b-3ca948145040 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:50.796561 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d7ed0c-7cbd-49be-948b-3ca948145040 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:50.803668 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 394/775] 10.222.0.23 () {56 vars in 1087 bytes} [Sun Oct 23 00:43:50 2022] GET /identity/v3/services => generated 1957 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:43:50.804292 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d7ed0c-7cbd-49be-948b-3ca948145040 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:50.833247 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52841bae-1949-42e9-b556-209739905728 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:50.846460 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:50.875848 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d55999-d2d2-4744-ad16-c114ea11b08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:50.876468 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d55999-d2d2-4744-ad16-c114ea11b08c None admin] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:50.876747 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d55999-d2d2-4744-ad16-c114ea11b08c None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:50.877016 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d55999-d2d2-4744-ad16-c114ea11b08c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:50.877699 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d55999-d2d2-4744-ad16-c114ea11b08c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:50.879853 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d55999-d2d2-4744-ad16-c114ea11b08c None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:50.897550 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 382/776] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 23 00:43:50 2022] POST /identity/v3/endpoints => generated 325 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:43:50.942343 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:50.947075 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d7ed0c-7cbd-49be-948b-3ca948145040 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:50.995406 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f67b1-7c2f-4333-86be-a9ae58c5f11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:50.996047 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f67b1-7c2f-4333-86be-a9ae58c5f11d None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:50.996301 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f67b1-7c2f-4333-86be-a9ae58c5f11d None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:50.996583 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f67b1-7c2f-4333-86be-a9ae58c5f11d None admin] PATH_INFO: `/v3/services` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:50.997227 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f67b1-7c2f-4333-86be-a9ae58c5f11d None admin] RBAC: Adding query filter params (type=image) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:50.997529 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f67b1-7c2f-4333-86be-a9ae58c5f11d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:50.999030 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f67b1-7c2f-4333-86be-a9ae58c5f11d None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:51.006044 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 395/777] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:43:50 2022] GET /identity/v3/services?type=image => generated 350 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:51.012236 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d55999-d2d2-4744-ad16-c114ea11b08c None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:51.124431 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d55999-d2d2-4744-ad16-c114ea11b08c None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:51.158444 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374e2b7-3161-4ad1-b817-78e10d0ca462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:51.159052 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374e2b7-3161-4ad1-b817-78e10d0ca462 None admin] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:51.159330 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374e2b7-3161-4ad1-b817-78e10d0ca462 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:51.159600 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374e2b7-3161-4ad1-b817-78e10d0ca462 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:51.160805 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374e2b7-3161-4ad1-b817-78e10d0ca462 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:51.162192 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374e2b7-3161-4ad1-b817-78e10d0ca462 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:51.183645 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 383/778] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 23 00:43:51 2022] POST /identity/v3/endpoints => generated 327 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:43:52.995625 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54591657-e80b-4ac9-b006-913dbab5ba21 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:52.996178 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54591657-e80b-4ac9-b006-913dbab5ba21 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:52.996178 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54591657-e80b-4ac9-b006-913dbab5ba21 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:52.997705 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 396/779] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:43:53.002724 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569aceb-d497-4821-ac32-cdbfe3ba23c4 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:53.003133 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569aceb-d497-4821-ac32-cdbfe3ba23c4 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:53.003293 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569aceb-d497-4821-ac32-cdbfe3ba23c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:53.021757 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-7569aceb-d497-4821-ac32-cdbfe3ba23c4 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:53.022986 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-7569aceb-d497-4821-ac32-cdbfe3ba23c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:53.042527 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:53.080414 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b3dbe-fe21-4881-9006-e8eff0df9612 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:53.080723 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b3dbe-fe21-4881-9006-e8eff0df9612 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:53.080970 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b3dbe-fe21-4881-9006-e8eff0df9612 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:53.082626 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 397/780] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:43:53.087380 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3d354-5e97-4ffd-95f8-f6c2095d865b None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:53.087665 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3d354-5e97-4ffd-95f8-f6c2095d865b None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:53.087938 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3d354-5e97-4ffd-95f8-f6c2095d865b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:53.096769 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 384/781] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:53 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:43:53.105749 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-b6c3d354-5e97-4ffd-95f8-f6c2095d865b None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:53.107227 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-b6c3d354-5e97-4ffd-95f8-f6c2095d865b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:53.172310 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 398/782] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:53 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 00:43:53.365832 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2a32a-659f-4f0e-a06b-f397d0683104 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:53.366006 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2a32a-659f-4f0e-a06b-f397d0683104 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:53.366322 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2a32a-659f-4f0e-a06b-f397d0683104 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:53.367831 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 385/783] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:43:53.368122 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c3d354-5e97-4ffd-95f8-f6c2095d865b None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:53.372467 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef8524-28ee-441a-9662-9be8ca2bb6bb None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:53.372757 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef8524-28ee-441a-9662-9be8ca2bb6bb None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:53.373030 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef8524-28ee-441a-9662-9be8ca2bb6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:53.391184 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-88ef8524-28ee-441a-9662-9be8ca2bb6bb None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:53.392376 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-88ef8524-28ee-441a-9662-9be8ca2bb6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:53.458779 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:53.464690 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 386/784] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:53 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 00:43:53.465681 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef8524-28ee-441a-9662-9be8ca2bb6bb None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:53.471447 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c3d354-5e97-4ffd-95f8-f6c2095d865b None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:53.507112 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49799b-88be-46e0-9211-dedc45410cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:53.507748 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49799b-88be-46e0-9211-dedc45410cd0 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:53.508029 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49799b-88be-46e0-9211-dedc45410cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:53.508305 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49799b-88be-46e0-9211-dedc45410cd0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:53.508888 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b49799b-88be-46e0-9211-dedc45410cd0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:53.510282 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b49799b-88be-46e0-9211-dedc45410cd0 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:53.519112 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-3b49799b-88be-46e0-9211-dedc45410cd0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 23 00:43:53.519112 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:53.519112 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:43:53.519112 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:43:53.519112 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:43:53.519112 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:43:53.519112 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:43:53.519112 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:43:53.519112 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 23 00:43:53.519112 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:53.519112 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:43:53.519112 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:53.519112 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:53.519112 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:53.519112 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:53.519112 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:53.519112 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:53.520210 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:53.520210 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:53.520210 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:53.520210 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:53.520210 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:53.520210 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:53.520210 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:43:53.520210 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:43:53.520210 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:43:53.520210 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:43:53.520210 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:53.520210 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:53.520210 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:53.520210 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:53.520210 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:53.520210 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:53.521534 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:53.521534 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:53.521534 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:53.521534 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:53.521534 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:53.521534 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:53.521534 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:53.521534 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:53.521534 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:53.521534 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:53.521534 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:43:53.521534 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:43:53.521534 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 23 00:43:53.521534 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:53.521534 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 399/785] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 23 00:43:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:43:53.525957 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49799b-88be-46e0-9211-dedc45410cd0 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:53.557935 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:53.586270 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef8524-28ee-441a-9662-9be8ca2bb6bb None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:53.623063 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56aa0df-83f8-4d87-884b-8dc37a412c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:53.623848 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56aa0df-83f8-4d87-884b-8dc37a412c07 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:53.623983 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56aa0df-83f8-4d87-884b-8dc37a412c07 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:53.624150 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56aa0df-83f8-4d87-884b-8dc37a412c07 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:53.625266 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56aa0df-83f8-4d87-884b-8dc37a412c07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:53.626726 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56aa0df-83f8-4d87-884b-8dc37a412c07 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:53.628466 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 387/786] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:43:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:53.634922 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56aa0df-83f8-4d87-884b-8dc37a412c07 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:53.635045 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49799b-88be-46e0-9211-dedc45410cd0 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:53.671500 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595a936-6675-427a-996d-12158e729aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:53.672105 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595a936-6675-427a-996d-12158e729aee None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:53.672385 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595a936-6675-427a-996d-12158e729aee None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:53.672655 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595a936-6675-427a-996d-12158e729aee None admin] PATH_INFO: `/v3/services` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:53.673277 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595a936-6675-427a-996d-12158e729aee None admin] RBAC: Adding query filter params (name=compute) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:53.673576 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595a936-6675-427a-996d-12158e729aee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:53.674977 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595a936-6675-427a-996d-12158e729aee None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:53.680002 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 400/787] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Oct 23 00:43:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:43:53.685378 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595a936-6675-427a-996d-12158e729aee None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:53.705591 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:53.740442 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56aa0df-83f8-4d87-884b-8dc37a412c07 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:53.774501 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adfe12b-74b2-4b3c-a3c4-10f6d9507ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:53.775097 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfe12b-74b2-4b3c-a3c4-10f6d9507ec8 None admin] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:53.775375 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfe12b-74b2-4b3c-a3c4-10f6d9507ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:53.775646 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfe12b-74b2-4b3c-a3c4-10f6d9507ec8 None admin] PATH_INFO: `/v3/projects` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:53.776287 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adfe12b-74b2-4b3c-a3c4-10f6d9507ec8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:53.777708 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adfe12b-74b2-4b3c-a3c4-10f6d9507ec8 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:53.790511 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595a936-6675-427a-996d-12158e729aee None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:53.805302 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 388/788] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Oct 23 00:43:53 2022] POST /identity/v3/projects => generated 311 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:43:53.806255 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adfe12b-74b2-4b3c-a3c4-10f6d9507ec8 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:53.824950 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:53.825448 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0ddc5-5430-4830-bfdd-ddef648d5ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:53.826319 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0ddc5-5430-4830-bfdd-ddef648d5ba8 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:53.826449 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0ddc5-5430-4830-bfdd-ddef648d5ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:53.826638 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0ddc5-5430-4830-bfdd-ddef648d5ba8 None admin] PATH_INFO: `/v3/services` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:53.828320 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f0ddc5-5430-4830-bfdd-ddef648d5ba8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:53.828646 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f0ddc5-5430-4830-bfdd-ddef648d5ba8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:53.830132 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f0ddc5-5430-4830-bfdd-ddef648d5ba8 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:53.841183 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 401/789] 10.222.0.23 () {56 vars in 1112 bytes} [Sun Oct 23 00:43:53 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:43:53.843218 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0ddc5-5430-4830-bfdd-ddef648d5ba8 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:53.944492 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adfe12b-74b2-4b3c-a3c4-10f6d9507ec8 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:53.949484 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:53.973521 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0ddc5-5430-4830-bfdd-ddef648d5ba8 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:53.985187 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0171a-00ba-4228-8cb5-06b63778484a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:53.985794 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0171a-00ba-4228-8cb5-06b63778484a None admin] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:53.986658 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0171a-00ba-4228-8cb5-06b63778484a None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:53.986658 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0171a-00ba-4228-8cb5-06b63778484a None admin] PATH_INFO: `/v3/domains` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:53.987019 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0171a-00ba-4228-8cb5-06b63778484a None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:53.988718 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0171a-00ba-4228-8cb5-06b63778484a None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:53.996443 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.sql.core [None req-d4c0171a-00ba-4228-8cb5-06b63778484a None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 23 00:43:53.996443 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 23 00:43:53.996443 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [parameters: {'id': '6abbc44cdb4e42aba6f36a44ffca2f4c', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 23 00:43:53.996443 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81358) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 23 00:43:54.004955 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-d4c0171a-00ba-4228-8cb5-06b63778484a None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 23 00:43:54.004955 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:54.004955 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 23 00:43:54.004955 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 23 00:43:54.004955 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 23 00:43:54.004955 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 23 00:43:54.004955 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 23 00:43:54.004955 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application result = self._query(query) Oct 23 00:43:54.004955 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 23 00:43:54.004955 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application conn.query(q) Oct 23 00:43:54.004955 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 23 00:43:54.004955 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 23 00:43:54.004955 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 23 00:43:54.004955 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application result.read() Oct 23 00:43:54.006532 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 23 00:43:54.006532 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 23 00:43:54.006532 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 23 00:43:54.006532 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 23 00:43:54.006532 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 23 00:43:54.006532 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 23 00:43:54.006532 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 23 00:43:54.006532 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 23 00:43:54.006532 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 23 00:43:54.006532 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:54.006532 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 23 00:43:54.006532 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:54.006532 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:54.006532 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 23 00:43:54.006532 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 23 00:43:54.006532 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 23 00:43:54.006532 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 23 00:43:54.006532 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 23 00:43:54.007472 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application next(self.gen) Oct 23 00:43:54.007472 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 23 00:43:54.007472 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application yield resource Oct 23 00:43:54.007472 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 23 00:43:54.007472 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application next(self.gen) Oct 23 00:43:54.007472 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 23 00:43:54.007472 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application self.session.rollback() Oct 23 00:43:54.007472 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 23 00:43:54.007472 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application self.force_reraise() Oct 23 00:43:54.007472 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 23 00:43:54.007472 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise self.value Oct 23 00:43:54.007472 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 23 00:43:54.007472 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 23 00:43:54.007472 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 23 00:43:54.007472 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application session.commit() Oct 23 00:43:54.007472 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 23 00:43:54.007472 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 23 00:43:54.008385 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 23 00:43:54.008385 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application self._prepare_impl() Oct 23 00:43:54.008385 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 23 00:43:54.008385 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application self.session.flush() Oct 23 00:43:54.008385 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 23 00:43:54.008385 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application self._flush(objects) Oct 23 00:43:54.008385 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 23 00:43:54.008385 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 23 00:43:54.008385 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 23 00:43:54.008385 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application compat.raise_( Oct 23 00:43:54.008385 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 00:43:54.008385 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception Oct 23 00:43:54.008385 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 23 00:43:54.008385 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application flush_context.execute() Oct 23 00:43:54.008385 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 23 00:43:54.008385 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rec.execute(self) Oct 23 00:43:54.008385 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 23 00:43:54.009260 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 23 00:43:54.009260 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 23 00:43:54.009260 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 23 00:43:54.009260 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 23 00:43:54.009260 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 23 00:43:54.009260 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 23 00:43:54.009260 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 23 00:43:54.009260 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 23 00:43:54.009260 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 23 00:43:54.009260 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 23 00:43:54.009260 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 23 00:43:54.009260 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 23 00:43:54.009260 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 23 00:43:54.009260 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 23 00:43:54.009260 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 23 00:43:54.010048 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 23 00:43:54.010048 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception Oct 23 00:43:54.010048 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 23 00:43:54.010048 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 23 00:43:54.010048 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 23 00:43:54.010048 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 23 00:43:54.010048 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 23 00:43:54.010048 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application result = self._query(query) Oct 23 00:43:54.010048 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 23 00:43:54.010048 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application conn.query(q) Oct 23 00:43:54.010048 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 23 00:43:54.010048 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 23 00:43:54.010048 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 23 00:43:54.010048 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application result.read() Oct 23 00:43:54.010048 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 23 00:43:54.010048 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 23 00:43:54.010048 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 23 00:43:54.010970 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 23 00:43:54.010970 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 23 00:43:54.010970 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 23 00:43:54.010970 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 23 00:43:54.010970 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 23 00:43:54.010970 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 23 00:43:54.010970 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 23 00:43:54.010970 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [parameters: {'id': '6abbc44cdb4e42aba6f36a44ffca2f4c', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 23 00:43:54.010970 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 23 00:43:54.010970 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:54.010970 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:43:54.010970 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:54.010970 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:54.010970 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 23 00:43:54.010970 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 23 00:43:54.011730 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 23 00:43:54.011730 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 23 00:43:54.011730 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 23 00:43:54.011730 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:54.011730 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:43:54.011730 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:54.011730 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:54.011730 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:54.011730 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:54.011730 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:54.011730 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:54.011730 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:54.011730 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:54.011730 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:54.011730 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:54.011730 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:54.011730 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:54.012614 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 23 00:43:54.012614 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 23 00:43:54.012614 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:54.012614 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:54.012614 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 23 00:43:54.012614 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 23 00:43:54.012614 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:54.012614 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:54.012614 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 23 00:43:54.012614 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 23 00:43:54.012614 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 23 00:43:54.012614 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:54.012614 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 389/790] 10.222.0.23 () {60 vars in 1137 bytes} [Sun Oct 23 00:43:53 2022] POST /identity/v3/domains => generated 190 bytes in 200 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:54.012614 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0171a-00ba-4228-8cb5-06b63778484a None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:54.015471 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46710e7-2f98-4604-8193-578c8261e731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:54.015471 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46710e7-2f98-4604-8193-578c8261e731 None admin] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:54.015471 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46710e7-2f98-4604-8193-578c8261e731 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:54.015471 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46710e7-2f98-4604-8193-578c8261e731 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:54.016399 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46710e7-2f98-4604-8193-578c8261e731 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:54.017711 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46710e7-2f98-4604-8193-578c8261e731 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:54.038892 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 402/791] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 23 00:43:53 2022] POST /identity/v3/endpoints => generated 334 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:43:54.090528 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:54.131945 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0171a-00ba-4228-8cb5-06b63778484a None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:54.176302 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33cc44e-06bf-461e-9f72-da40e4f378cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:54.176942 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cc44e-06bf-461e-9f72-da40e4f378cd None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:54.177272 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cc44e-06bf-461e-9f72-da40e4f378cd None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:54.177547 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cc44e-06bf-461e-9f72-da40e4f378cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:54.189426 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33cc44e-06bf-461e-9f72-da40e4f378cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:54.190934 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33cc44e-06bf-461e-9f72-da40e4f378cd None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:54.206634 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-e33cc44e-06bf-461e-9f72-da40e4f378cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:54.206634 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:54.206634 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:54.206634 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:54.206634 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:54.206634 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:54.206634 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:54.206634 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:54.206634 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:54.206634 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:54.206634 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:54.206634 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:54.206634 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:43:54.206634 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:43:54.206634 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:43:54.206634 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:43:54.207670 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:54.207670 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:54.207670 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:54.207670 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:54.207670 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:54.207670 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:54.207670 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:54.207670 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:54.207670 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:54.207670 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:54.207670 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:54.207670 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:54.207670 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:54.207670 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:54.207670 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:54.207670 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:54.207670 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:43:54.208586 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:43:54.208586 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:54.208586 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:54.208586 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 390/792] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:43:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:54.215321 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46710e7-2f98-4604-8193-578c8261e731 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:54.326216 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46710e7-2f98-4604-8193-578c8261e731 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:54.362979 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2e38f-3a41-48f9-bec2-5b1b1c63cf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:54.364146 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2e38f-3a41-48f9-bec2-5b1b1c63cf14 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:54.364429 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2e38f-3a41-48f9-bec2-5b1b1c63cf14 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:54.364704 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2e38f-3a41-48f9-bec2-5b1b1c63cf14 None admin] PATH_INFO: `/v3/domains` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:54.365347 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2e38f-3a41-48f9-bec2-5b1b1c63cf14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:54.365650 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2e38f-3a41-48f9-bec2-5b1b1c63cf14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:54.367061 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2e38f-3a41-48f9-bec2-5b1b1c63cf14 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:54.370034 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:54.381532 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 403/793] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:43:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:56.016276 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb5c07-e94a-44ac-91d3-06e6925b6842 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:56.016805 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb5c07-e94a-44ac-91d3-06e6925b6842 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:56.016805 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb5c07-e94a-44ac-91d3-06e6925b6842 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:56.018307 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 391/794] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:43:56.023378 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2dc03-d27f-43a8-831b-f1a19ce11f0e None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:56.023768 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2dc03-d27f-43a8-831b-f1a19ce11f0e None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:56.023921 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2dc03-d27f-43a8-831b-f1a19ce11f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:56.041496 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-23e2dc03-d27f-43a8-831b-f1a19ce11f0e None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:56.042706 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-23e2dc03-d27f-43a8-831b-f1a19ce11f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:56.109908 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 404/795] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:43:56.293299 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31736e1c-e799-4f5d-899d-4d03d5e34a41 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:56.293607 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31736e1c-e799-4f5d-899d-4d03d5e34a41 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:56.293949 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31736e1c-e799-4f5d-899d-4d03d5e34a41 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:56.295376 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 392/796] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:43:56.301273 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5ef3c-b46b-42dd-836d-f627a0cbd529 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:56.301729 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5ef3c-b46b-42dd-836d-f627a0cbd529 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:56.302007 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5ef3c-b46b-42dd-836d-f627a0cbd529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:56.319866 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-1eb5ef3c-b46b-42dd-836d-f627a0cbd529 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:56.321050 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-1eb5ef3c-b46b-42dd-836d-f627a0cbd529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:56.377973 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31736e1c-e799-4f5d-899d-4d03d5e34a41 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:56.386037 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 405/797] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:43:56.477288 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31736e1c-e799-4f5d-899d-4d03d5e34a41 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:56.491051 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:56.510319 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d85cc8-1e87-4312-819a-ab6d47130405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:56.510932 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d85cc8-1e87-4312-819a-ab6d47130405 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:56.511207 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d85cc8-1e87-4312-819a-ab6d47130405 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:56.511472 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d85cc8-1e87-4312-819a-ab6d47130405 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:56.512568 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d85cc8-1e87-4312-819a-ab6d47130405 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:56.514004 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d85cc8-1e87-4312-819a-ab6d47130405 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:56.515574 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 393/798] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:43:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:43:56.521362 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5ef3c-b46b-42dd-836d-f627a0cbd529 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:56.575684 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:56.619008 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5ef3c-b46b-42dd-836d-f627a0cbd529 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:56.652151 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d85cc8-1e87-4312-819a-ab6d47130405 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:56.652462 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a117f16-a413-421d-a513-cbb765b82029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:56.653072 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a117f16-a413-421d-a513-cbb765b82029 None admin] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:56.653352 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a117f16-a413-421d-a513-cbb765b82029 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:56.653624 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a117f16-a413-421d-a513-cbb765b82029 None admin] PATH_INFO: `/v3/users` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:56.654308 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a117f16-a413-421d-a513-cbb765b82029 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:56.655752 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a117f16-a413-421d-a513-cbb765b82029 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:56.677823 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 406/799] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 23 00:43:56 2022] POST /identity/v3/users => generated 285 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:43:56.758927 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d85cc8-1e87-4312-819a-ab6d47130405 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:56.794481 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7686e1-6898-49a1-a362-d1350ec46be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:56.795122 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7686e1-6898-49a1-a362-d1350ec46be6 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:56.795399 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7686e1-6898-49a1-a362-d1350ec46be6 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:56.795670 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7686e1-6898-49a1-a362-d1350ec46be6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:56.807357 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7686e1-6898-49a1-a362-d1350ec46be6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:43:56.812770 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-7c7686e1-6898-49a1-a362-d1350ec46be6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 23 00:43:56.812770 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:56.812770 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:56.812770 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:56.812770 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:56.812770 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:56.812770 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:56.812770 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:56.812770 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:56.812770 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:56.812770 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:56.812770 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:56.812770 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:43:56.812770 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:43:56.812770 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:43:56.812770 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:43:56.813844 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:43:56.813844 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:43:56.813844 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:43:56.813844 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:43:56.813844 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:56.813844 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:56.813844 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:56.813844 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:56.813844 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:56.813844 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:56.813844 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:56.813844 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:56.813844 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:56.813844 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:56.813844 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:56.813844 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:56.815080 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:56.815080 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:56.815080 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:56.815080 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:56.815080 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:43:56.815080 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:43:56.815080 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:43:56.815080 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:43:56.815080 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:43:56.815080 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:43:56.815080 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 23 00:43:56.815080 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:56.815080 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 394/800] 10.222.0.23 () {56 vars in 1120 bytes} [Sun Oct 23 00:43:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:43:56.820727 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a117f16-a413-421d-a513-cbb765b82029 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:56.923304 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a117f16-a413-421d-a513-cbb765b82029 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:56.937142 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:56.960122 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d2d75c-e393-4c06-b2c3-0005c7a56bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:56.960730 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d2d75c-e393-4c06-b2c3-0005c7a56bb0 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:56.961010 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d2d75c-e393-4c06-b2c3-0005c7a56bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:56.961282 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d2d75c-e393-4c06-b2c3-0005c7a56bb0 None admin] PATH_INFO: `/v3/roles` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:56.961942 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d2d75c-e393-4c06-b2c3-0005c7a56bb0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:56.962276 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d2d75c-e393-4c06-b2c3-0005c7a56bb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:56.963646 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d2d75c-e393-4c06-b2c3-0005c7a56bb0 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:56.972257 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 407/801] 10.222.0.23 () {56 vars in 1115 bytes} [Sun Oct 23 00:43:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:56.977989 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7686e1-6898-49a1-a362-d1350ec46be6 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:57.021482 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:57.077298 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7686e1-6898-49a1-a362-d1350ec46be6 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:57.109619 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33497068-58f9-450b-a56e-ccfa02f31e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:57.110270 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33497068-58f9-450b-a56e-ccfa02f31e63 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:57.110553 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33497068-58f9-450b-a56e-ccfa02f31e63 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:57.110826 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33497068-58f9-450b-a56e-ccfa02f31e63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:57.121540 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33497068-58f9-450b-a56e-ccfa02f31e63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:57.123008 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33497068-58f9-450b-a56e-ccfa02f31e63 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:57.136717 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-33497068-58f9-450b-a56e-ccfa02f31e63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:57.136717 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:57.136717 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:57.136717 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:57.136717 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:57.136717 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:57.136717 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:57.136717 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:57.136717 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:57.136717 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:57.136717 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:57.136717 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:57.136717 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:43:57.136717 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:43:57.136717 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:43:57.136717 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:43:57.137631 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:57.137631 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:57.137631 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:57.137631 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:57.137631 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:57.137631 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:57.137631 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:57.137631 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:57.137631 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:57.137631 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:57.137631 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:57.137631 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:57.137631 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:57.137631 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:57.137631 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:57.137631 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:57.137631 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:43:57.138688 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:43:57.138688 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:57.138688 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:57.138688 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 395/802] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:43:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:43:57.143520 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d2d75c-e393-4c06-b2c3-0005c7a56bb0 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:57.244739 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d2d75c-e393-4c06-b2c3-0005c7a56bb0 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:57.278654 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84a8ab-d8ee-431c-9ec4-03ee3bff46d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:57.279253 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84a8ab-d8ee-431c-9ec4-03ee3bff46d4 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:57.279532 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84a8ab-d8ee-431c-9ec4-03ee3bff46d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:57.279801 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84a8ab-d8ee-431c-9ec4-03ee3bff46d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:57.280440 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f84a8ab-d8ee-431c-9ec4-03ee3bff46d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:57.280738 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f84a8ab-d8ee-431c-9ec4-03ee3bff46d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:57.282134 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f84a8ab-d8ee-431c-9ec4-03ee3bff46d4 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:57.293503 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 408/803] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:57.299207 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33497068-58f9-450b-a56e-ccfa02f31e63 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:57.390196 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:57.397887 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33497068-58f9-450b-a56e-ccfa02f31e63 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:57.431466 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf33e17b-6b1c-4feb-953c-8b3713f1598a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:57.432081 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33e17b-6b1c-4feb-953c-8b3713f1598a None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:57.432359 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33e17b-6b1c-4feb-953c-8b3713f1598a None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:57.432627 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33e17b-6b1c-4feb-953c-8b3713f1598a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:57.440081 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf33e17b-6b1c-4feb-953c-8b3713f1598a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:57.441518 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf33e17b-6b1c-4feb-953c-8b3713f1598a None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:57.452544 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-bf33e17b-6b1c-4feb-953c-8b3713f1598a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 23 00:43:57.452544 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:57.452544 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:57.452544 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:57.452544 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:57.452544 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:57.452544 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:57.452544 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:57.452544 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:57.452544 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:57.452544 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:57.452544 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:57.452544 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 00:43:57.452544 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 00:43:57.452544 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 00:43:57.452544 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 00:43:57.453545 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:57.453545 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:57.453545 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:43:57.453545 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:43:57.453545 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:43:57.453545 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:43:57.453545 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:57.453545 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:57.453545 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:57.453545 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:57.453545 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:57.453545 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:57.453545 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:57.453545 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:57.453545 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:57.453545 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:57.453545 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:57.453545 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:57.454534 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:57.454534 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:57.454534 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 00:43:57.454534 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 00:43:57.454534 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 00:43:57.454534 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 00:43:57.454534 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 00:43:57.454534 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 00:43:57.454534 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 23 00:43:57.454534 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:57.454534 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 396/804] 10.222.0.23 () {56 vars in 1093 bytes} [Sun Oct 23 00:43:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:43:57.460044 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84a8ab-d8ee-431c-9ec4-03ee3bff46d4 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:57.494201 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:57.558340 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84a8ab-d8ee-431c-9ec4-03ee3bff46d4 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:57.592178 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564280e-cf00-4667-a2d9-792e4f31878c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:57.592786 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564280e-cf00-4667-a2d9-792e4f31878c None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:57.593067 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564280e-cf00-4667-a2d9-792e4f31878c None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:57.593341 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564280e-cf00-4667-a2d9-792e4f31878c None admin] PATH_INFO: `/v3/users` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:57.594084 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e564280e-cf00-4667-a2d9-792e4f31878c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:57.594402 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e564280e-cf00-4667-a2d9-792e4f31878c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:57.595839 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e564280e-cf00-4667-a2d9-792e4f31878c None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:57.614452 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 409/805] 10.222.0.23 () {56 vars in 1133 bytes} [Sun Oct 23 00:43:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:57.620218 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf33e17b-6b1c-4feb-953c-8b3713f1598a None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:57.716345 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf33e17b-6b1c-4feb-953c-8b3713f1598a None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:57.748639 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ee0db-eac8-4787-a5d0-df6d3d39bbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:57.749198 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ee0db-eac8-4787-a5d0-df6d3d39bbf0 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:57.749453 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ee0db-eac8-4787-a5d0-df6d3d39bbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:57.749718 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ee0db-eac8-4787-a5d0-df6d3d39bbf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:57.762688 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ee0db-eac8-4787-a5d0-df6d3d39bbf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:57.764129 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ee0db-eac8-4787-a5d0-df6d3d39bbf0 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:57.778360 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-334ee0db-eac8-4787-a5d0-df6d3d39bbf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:57.778360 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:57.778360 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:57.778360 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:57.778360 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:57.778360 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:57.778360 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:57.778360 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:57.778360 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:57.778360 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:57.778360 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:57.778360 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:57.778360 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:43:57.778360 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:43:57.778360 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:43:57.778360 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:43:57.779272 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:57.779272 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:57.779272 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:57.779272 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:57.779272 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:57.779272 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:57.779272 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:57.779272 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:57.779272 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:57.779272 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:57.779272 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:57.779272 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:57.779272 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:57.779272 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:57.779272 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:57.779272 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:57.779272 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:43:57.780189 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:43:57.780189 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:43:57.780189 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:57.780189 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 397/806] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:43:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:57.785120 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564280e-cf00-4667-a2d9-792e4f31878c None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:57.872834 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:57.882266 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564280e-cf00-4667-a2d9-792e4f31878c None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:57.915813 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772aba8b-269b-46b3-9965-d98cfc258678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:57.916414 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772aba8b-269b-46b3-9965-d98cfc258678 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:57.916694 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772aba8b-269b-46b3-9965-d98cfc258678 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:57.916965 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772aba8b-269b-46b3-9965-d98cfc258678 None admin] PATH_INFO: `/v3/domains` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:57.917607 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772aba8b-269b-46b3-9965-d98cfc258678 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:57.917905 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772aba8b-269b-46b3-9965-d98cfc258678 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:57.919353 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772aba8b-269b-46b3-9965-d98cfc258678 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:57.930487 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 410/807] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:57.936019 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ee0db-eac8-4787-a5d0-df6d3d39bbf0 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:57.945849 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:58.033337 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ee0db-eac8-4787-a5d0-df6d3d39bbf0 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:58.064308 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9803c62e-592d-41ce-8fb8-f582ebb498b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:58.064920 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803c62e-592d-41ce-8fb8-f582ebb498b6 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:58.065193 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803c62e-592d-41ce-8fb8-f582ebb498b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:58.065459 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803c62e-592d-41ce-8fb8-f582ebb498b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:58.072259 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9803c62e-592d-41ce-8fb8-f582ebb498b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:58.073685 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9803c62e-592d-41ce-8fb8-f582ebb498b6 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:58.085005 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-9803c62e-592d-41ce-8fb8-f582ebb498b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:43:58.085005 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:58.085005 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:58.085005 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:58.085005 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:58.085005 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:58.085005 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:58.085005 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:58.085005 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:58.085005 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:58.085005 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:58.085005 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:58.085005 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 00:43:58.085005 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 00:43:58.085005 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 00:43:58.086025 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 00:43:58.086025 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:58.086025 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:58.086025 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:58.086025 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:58.086025 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:58.086025 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:58.086025 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:58.086025 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:58.086025 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:58.086025 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:58.086025 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:58.086025 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:58.086025 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:58.086025 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:58.086025 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:58.086025 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:58.091579 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 00:43:58.091579 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 00:43:58.091579 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 00:43:58.091579 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 00:43:58.091579 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 00:43:58.091579 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 00:43:58.091579 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:43:58.091579 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:43:58.091579 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 398/808] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 23 00:43:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:43:58.092067 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772aba8b-269b-46b3-9965-d98cfc258678 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:58.187365 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772aba8b-269b-46b3-9965-d98cfc258678 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:58.219528 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4427533f-6a34-4cc7-8de3-3c9bddad2777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:58.220114 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427533f-6a34-4cc7-8de3-3c9bddad2777 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:58.220389 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427533f-6a34-4cc7-8de3-3c9bddad2777 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:58.220654 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427533f-6a34-4cc7-8de3-3c9bddad2777 None admin] PATH_INFO: `/v3/projects` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:58.221330 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4427533f-6a34-4cc7-8de3-3c9bddad2777 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:58.221663 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4427533f-6a34-4cc7-8de3-3c9bddad2777 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:58.223146 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4427533f-6a34-4cc7-8de3-3c9bddad2777 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:58.235845 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 411/809] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 23 00:43:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:43:58.242494 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9803c62e-592d-41ce-8fb8-f582ebb498b6 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:58.305570 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:58.340154 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9803c62e-592d-41ce-8fb8-f582ebb498b6 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:58.373477 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138e115-de94-47d1-bf6c-2d810ecb5f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:58.374142 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138e115-de94-47d1-bf6c-2d810ecb5f43 None admin] REQUEST_METHOD: `PUT` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:58.374422 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138e115-de94-47d1-bf6c-2d810ecb5f43 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:58.374693 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138e115-de94-47d1-bf6c-2d810ecb5f43 None admin] PATH_INFO: `/v3/projects/60f8594760e44ce3888a32702ea9afcc/users/90f691140a8341ada73a8c6f01ad798c/roles/e1cc8c321c304deaa299e74b57532d98` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:58.376778 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138e115-de94-47d1-bf6c-2d810ecb5f43 None admin] RBAC: Authorizing `identity:create_grant(project_id=60f8594760e44ce3888a32702ea9afcc, user_id=90f691140a8341ada73a8c6f01ad798c, role_id=e1cc8c321c304deaa299e74b57532d98)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:58.378235 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e138e115-de94-47d1-bf6c-2d810ecb5f43 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:58.390906 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 399/810] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 23 00:43:58 2022] PUT /identity/v3/projects/60f8594760e44ce3888a32702ea9afcc/users/90f691140a8341ada73a8c6f01ad798c/roles/e1cc8c321c304deaa299e74b57532d98 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:43:58.865421 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509aa151-a121-4a62-95a1-2d059c23f9a8 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:58.865821 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509aa151-a121-4a62-95a1-2d059c23f9a8 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:58.866127 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509aa151-a121-4a62-95a1-2d059c23f9a8 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:58.867490 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 412/811] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:43:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:43:58.872877 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42baf1e2-118a-4298-91b0-686d46519e3e None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:58.873173 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42baf1e2-118a-4298-91b0-686d46519e3e None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:58.873453 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42baf1e2-118a-4298-91b0-686d46519e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:58.891220 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-42baf1e2-118a-4298-91b0-686d46519e3e None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:43:58.892412 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-42baf1e2-118a-4298-91b0-686d46519e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:43:58.958284 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 400/812] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:43:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:43:59.226406 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509aa151-a121-4a62-95a1-2d059c23f9a8 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:59.246856 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:59.329157 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509aa151-a121-4a62-95a1-2d059c23f9a8 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:59.361936 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d57c8-95cb-45a2-8c64-babf6a7d13d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:59.362580 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d57c8-95cb-45a2-8c64-babf6a7d13d2 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:59.362858 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d57c8-95cb-45a2-8c64-babf6a7d13d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:59.363128 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d57c8-95cb-45a2-8c64-babf6a7d13d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:59.372913 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098d57c8-95cb-45a2-8c64-babf6a7d13d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:43:59.377689 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-098d57c8-95cb-45a2-8c64-babf6a7d13d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:43:59.377689 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:43:59.377689 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:43:59.377689 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:43:59.377689 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:43:59.377689 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:43:59.377689 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:43:59.377689 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:43:59.377689 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:43:59.377689 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:43:59.377689 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:43:59.377689 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:43:59.377689 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:43:59.377689 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:43:59.377689 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:43:59.377689 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:43:59.379383 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:43:59.379383 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:43:59.379383 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:43:59.379383 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:43:59.379383 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:43:59.379383 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:43:59.379383 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:43:59.379383 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:43:59.379383 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:43:59.379383 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:43:59.379383 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:43:59.379383 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:43:59.379383 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:43:59.379383 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:43:59.379383 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:43:59.379383 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:43:59.380273 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:43:59.380273 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:43:59.380273 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:43:59.380273 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:43:59.380273 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:43:59.380273 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:43:59.380273 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:43:59.380273 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:43:59.380273 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:43:59.380273 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:43:59.380273 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:43:59.380273 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:43:59.380273 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 413/813] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 23 00:43:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:43:59.385486 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42baf1e2-118a-4298-91b0-686d46519e3e None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:59.438057 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:59.481618 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42baf1e2-118a-4298-91b0-686d46519e3e None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:59.513817 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12b95b-e535-4538-b240-83441dfaeaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:59.514435 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12b95b-e535-4538-b240-83441dfaeaff None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:59.514715 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12b95b-e535-4538-b240-83441dfaeaff None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:59.514986 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12b95b-e535-4538-b240-83441dfaeaff None admin] PATH_INFO: `/v3/roles` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:59.515640 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa12b95b-e535-4538-b240-83441dfaeaff None admin] RBAC: Adding query filter params (name=admin) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:43:59.515937 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa12b95b-e535-4538-b240-83441dfaeaff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:59.517304 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa12b95b-e535-4538-b240-83441dfaeaff None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:59.525194 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 401/814] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 23 00:43:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:59.530871 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d57c8-95cb-45a2-8c64-babf6a7d13d2 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:59.601687 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:59.634049 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d57c8-95cb-45a2-8c64-babf6a7d13d2 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:59.667370 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78a791-4c11-49ab-89d8-46209838872b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:59.667988 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78a791-4c11-49ab-89d8-46209838872b None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:59.668371 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78a791-4c11-49ab-89d8-46209838872b None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:59.668642 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78a791-4c11-49ab-89d8-46209838872b None admin] PATH_INFO: `/v3/users/ecba98e2e96c44b9b6c4524b853c8b89` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:59.681315 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec78a791-4c11-49ab-89d8-46209838872b None admin] RBAC: Authorizing `identity:get_user(user_id=ecba98e2e96c44b9b6c4524b853c8b89)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:59.682791 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec78a791-4c11-49ab-89d8-46209838872b None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:59.684377 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 414/815] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 23 00:43:59 2022] GET /identity/v3/users/ecba98e2e96c44b9b6c4524b853c8b89 => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:59.690243 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12b95b-e535-4538-b240-83441dfaeaff None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:59.786564 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12b95b-e535-4538-b240-83441dfaeaff None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:59.802703 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:59.819222 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e5765-c345-4b75-a4ec-00ccc30c69e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:59.819838 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e5765-c345-4b75-a4ec-00ccc30c69e8 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:59.820117 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e5765-c345-4b75-a4ec-00ccc30c69e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:59.820389 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e5765-c345-4b75-a4ec-00ccc30c69e8 None admin] PATH_INFO: `/v3/projects/65be930fe50a46cb801f4bd36e349034` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:59.821484 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e5765-c345-4b75-a4ec-00ccc30c69e8 None admin] RBAC: Authorizing `identity:get_project(project_id=65be930fe50a46cb801f4bd36e349034)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:59.822946 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e5765-c345-4b75-a4ec-00ccc30c69e8 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:59.824556 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 402/816] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 23 00:43:59 2022] GET /identity/v3/projects/65be930fe50a46cb801f4bd36e349034 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:43:59.830555 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78a791-4c11-49ab-89d8-46209838872b None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:43:59.927697 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78a791-4c11-49ab-89d8-46209838872b None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:43:59.954983 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:43:59.961662 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29493c3b-ec99-41f1-aca1-4dbe8d42710c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:43:59.962343 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29493c3b-ec99-41f1-aca1-4dbe8d42710c None admin] REQUEST_METHOD: `PUT` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:43:59.962626 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29493c3b-ec99-41f1-aca1-4dbe8d42710c None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:43:59.962900 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29493c3b-ec99-41f1-aca1-4dbe8d42710c None admin] PATH_INFO: `/v3/projects/65be930fe50a46cb801f4bd36e349034/users/ecba98e2e96c44b9b6c4524b853c8b89/roles/1e2073be75174689aa4fac29e674583d` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:43:59.964789 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29493c3b-ec99-41f1-aca1-4dbe8d42710c None admin] RBAC: Authorizing `identity:create_grant(project_id=65be930fe50a46cb801f4bd36e349034, user_id=ecba98e2e96c44b9b6c4524b853c8b89, role_id=1e2073be75174689aa4fac29e674583d)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:43:59.966268 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29493c3b-ec99-41f1-aca1-4dbe8d42710c None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:43:59.978949 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 415/817] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 23 00:43:59 2022] PUT /identity/v3/projects/65be930fe50a46cb801f4bd36e349034/users/ecba98e2e96c44b9b6c4524b853c8b89/roles/1e2073be75174689aa4fac29e674583d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:44:00.502349 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc31a4-dbdf-4c92-8af1-95e4b74353d8 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:00.502872 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc31a4-dbdf-4c92-8af1-95e4b74353d8 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:00.502872 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc31a4-dbdf-4c92-8af1-95e4b74353d8 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:00.504729 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 403/818] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:44:00.510132 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc702d1-cce1-450a-bd4f-bdaa5c86f9e3 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:00.510556 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc702d1-cce1-450a-bd4f-bdaa5c86f9e3 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:00.510680 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc702d1-cce1-450a-bd4f-bdaa5c86f9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:00.528310 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-ffc702d1-cce1-450a-bd4f-bdaa5c86f9e3 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:44:00.529472 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-ffc702d1-cce1-450a-bd4f-bdaa5c86f9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:44:00.592865 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 416/819] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:44:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:44:00.859293 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc31a4-dbdf-4c92-8af1-95e4b74353d8 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:00.958154 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc31a4-dbdf-4c92-8af1-95e4b74353d8 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:00.990647 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6618a2-21c4-4a01-a1cb-1b0452a650a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:00.991252 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6618a2-21c4-4a01-a1cb-1b0452a650a8 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:00.991529 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6618a2-21c4-4a01-a1cb-1b0452a650a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:00.991794 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6618a2-21c4-4a01-a1cb-1b0452a650a8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:01.001755 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6618a2-21c4-4a01-a1cb-1b0452a650a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:44:01.006577 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-ba6618a2-21c4-4a01-a1cb-1b0452a650a8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 23 00:44:01.006577 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:44:01.006577 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:44:01.006577 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:44:01.006577 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:44:01.006577 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:44:01.006577 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:44:01.006577 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:44:01.006577 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:44:01.006577 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:44:01.006577 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:44:01.006577 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:44:01.006577 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:44:01.006577 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:44:01.006577 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:44:01.006577 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:44:01.007677 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:44:01.007677 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:44:01.007677 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:44:01.007677 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:44:01.007677 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:44:01.007677 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:44:01.007677 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:44:01.007677 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:44:01.007677 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:44:01.007677 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:44:01.007677 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:44:01.007677 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:44:01.007677 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:44:01.007677 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:44:01.007677 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:44:01.007677 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:44:01.008762 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:44:01.008762 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:44:01.008762 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:44:01.008762 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:44:01.008762 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:44:01.008762 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:44:01.008762 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:44:01.008762 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:44:01.008762 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:44:01.008762 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:44:01.008762 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 23 00:44:01.008762 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:44:01.008762 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 404/820] 10.222.0.23 () {56 vars in 1120 bytes} [Sun Oct 23 00:44:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:44:01.016107 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc702d1-cce1-450a-bd4f-bdaa5c86f9e3 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:01.111952 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc702d1-cce1-450a-bd4f-bdaa5c86f9e3 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:01.131803 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:01.147088 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e158e9d0-366a-43ef-8fc1-4627a41d5cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:01.147701 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158e9d0-366a-43ef-8fc1-4627a41d5cb5 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:01.147980 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158e9d0-366a-43ef-8fc1-4627a41d5cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:01.148252 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158e9d0-366a-43ef-8fc1-4627a41d5cb5 None admin] PATH_INFO: `/v3/roles` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:01.148915 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e158e9d0-366a-43ef-8fc1-4627a41d5cb5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:44:01.149217 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e158e9d0-366a-43ef-8fc1-4627a41d5cb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:01.150629 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e158e9d0-366a-43ef-8fc1-4627a41d5cb5 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:01.158597 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 417/821] 10.222.0.23 () {56 vars in 1115 bytes} [Sun Oct 23 00:44:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:44:01.164956 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6618a2-21c4-4a01-a1cb-1b0452a650a8 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:01.211842 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:01.264220 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6618a2-21c4-4a01-a1cb-1b0452a650a8 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:01.297131 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd177d73-1728-4bcc-8101-a86f55de0b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:01.297750 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd177d73-1728-4bcc-8101-a86f55de0b48 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:01.298031 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd177d73-1728-4bcc-8101-a86f55de0b48 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:01.298335 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd177d73-1728-4bcc-8101-a86f55de0b48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:01.308959 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd177d73-1728-4bcc-8101-a86f55de0b48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:01.310432 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd177d73-1728-4bcc-8101-a86f55de0b48 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:01.324632 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-cd177d73-1728-4bcc-8101-a86f55de0b48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:44:01.324632 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:44:01.324632 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:44:01.324632 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:44:01.324632 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:44:01.324632 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:44:01.324632 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:44:01.324632 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:44:01.324632 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:44:01.324632 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:44:01.324632 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:44:01.324632 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:44:01.324632 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:44:01.324632 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:44:01.324632 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:44:01.324632 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:44:01.325684 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:44:01.325684 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:44:01.325684 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:44:01.325684 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:44:01.325684 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:44:01.325684 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:44:01.325684 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:44:01.325684 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:44:01.325684 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:44:01.325684 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:44:01.325684 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:44:01.325684 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:44:01.325684 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:44:01.325684 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:44:01.325684 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:44:01.325684 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:44:01.325684 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:44:01.327134 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:44:01.327134 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:44:01.327134 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:44:01.327134 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 405/822] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:44:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:44:01.331377 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e158e9d0-366a-43ef-8fc1-4627a41d5cb5 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:01.428634 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e158e9d0-366a-43ef-8fc1-4627a41d5cb5 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:01.461284 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706e33b-8e00-45b1-bd81-560e3b30ff41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:01.461878 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706e33b-8e00-45b1-bd81-560e3b30ff41 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:01.462195 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706e33b-8e00-45b1-bd81-560e3b30ff41 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:01.462468 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706e33b-8e00-45b1-bd81-560e3b30ff41 None admin] PATH_INFO: `/v3/domains` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:01.463104 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706e33b-8e00-45b1-bd81-560e3b30ff41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:44:01.463405 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706e33b-8e00-45b1-bd81-560e3b30ff41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:01.464769 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706e33b-8e00-45b1-bd81-560e3b30ff41 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:01.475996 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 418/823] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:44:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:44:01.481786 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd177d73-1728-4bcc-8101-a86f55de0b48 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:01.576066 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:01.580075 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd177d73-1728-4bcc-8101-a86f55de0b48 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:01.614008 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4a05a-460b-4979-ac12-857ca10eba66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:01.614656 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4a05a-460b-4979-ac12-857ca10eba66 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:01.614939 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4a05a-460b-4979-ac12-857ca10eba66 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:01.615212 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4a05a-460b-4979-ac12-857ca10eba66 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:01.622385 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e4a05a-460b-4979-ac12-857ca10eba66 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:01.623820 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e4a05a-460b-4979-ac12-857ca10eba66 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:01.638908 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-a7e4a05a-460b-4979-ac12-857ca10eba66 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 23 00:44:01.638908 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:44:01.638908 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:44:01.638908 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:44:01.638908 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:44:01.638908 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:44:01.638908 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:44:01.638908 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:44:01.638908 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:44:01.638908 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:44:01.638908 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:44:01.638908 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:44:01.638908 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 00:44:01.638908 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 00:44:01.638908 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 00:44:01.638908 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 00:44:01.640096 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:44:01.640096 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:44:01.640096 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:44:01.640096 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:44:01.640096 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:44:01.640096 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:44:01.640096 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:44:01.640096 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:44:01.640096 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:44:01.640096 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:44:01.640096 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:44:01.640096 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:44:01.640096 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:44:01.640096 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:44:01.640096 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:44:01.640096 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:44:01.640096 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:44:01.640096 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:44:01.641171 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:44:01.641171 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:44:01.641171 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 00:44:01.641171 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 00:44:01.641171 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 00:44:01.641171 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 00:44:01.641171 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 00:44:01.641171 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 00:44:01.641171 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 23 00:44:01.641171 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:44:01.642232 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 406/824] 10.222.0.23 () {56 vars in 1093 bytes} [Sun Oct 23 00:44:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:44:01.645840 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706e33b-8e00-45b1-bd81-560e3b30ff41 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:01.689815 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:01.745830 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706e33b-8e00-45b1-bd81-560e3b30ff41 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:01.896953 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a3c62-2d24-445a-870f-08e988aa24d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:01.897548 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a3c62-2d24-445a-870f-08e988aa24d4 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:01.897826 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a3c62-2d24-445a-870f-08e988aa24d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:01.898116 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a3c62-2d24-445a-870f-08e988aa24d4 None admin] PATH_INFO: `/v3/users` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:01.898838 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a3c62-2d24-445a-870f-08e988aa24d4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:44:01.899139 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a3c62-2d24-445a-870f-08e988aa24d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:01.900555 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a3c62-2d24-445a-870f-08e988aa24d4 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:01.917658 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 419/825] 10.222.0.23 () {56 vars in 1133 bytes} [Sun Oct 23 00:44:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:44:01.923432 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4a05a-460b-4979-ac12-857ca10eba66 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:02.023439 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4a05a-460b-4979-ac12-857ca10eba66 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:02.055794 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14c1b3-8f1f-4fb9-9b9a-4a4b317f8cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:02.056384 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14c1b3-8f1f-4fb9-9b9a-4a4b317f8cb8 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:02.056660 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14c1b3-8f1f-4fb9-9b9a-4a4b317f8cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:02.056935 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14c1b3-8f1f-4fb9-9b9a-4a4b317f8cb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:02.082772 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:02.109490 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478cef4-d3ee-4d17-ab2e-cf975dc4c0ee None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:02.109766 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478cef4-d3ee-4d17-ab2e-cf975dc4c0ee None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:02.110037 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478cef4-d3ee-4d17-ab2e-cf975dc4c0ee None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:02.111415 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 420/826] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:44:02.116946 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6fb87-cf50-48c5-89b7-9ce3d74cb66e None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:02.117301 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6fb87-cf50-48c5-89b7-9ce3d74cb66e None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:02.117693 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6fb87-cf50-48c5-89b7-9ce3d74cb66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:02.122819 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f14c1b3-8f1f-4fb9-9b9a-4a4b317f8cb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:02.124282 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f14c1b3-8f1f-4fb9-9b9a-4a4b317f8cb8 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:02.135812 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-7ab6fb87-cf50-48c5-89b7-9ce3d74cb66e None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:44:02.137024 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-7ab6fb87-cf50-48c5-89b7-9ce3d74cb66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:44:02.202771 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 421/827] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:44:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 00:44:02.225304 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 407/828] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 23 00:44:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 23 00:44:02.226496 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab6fb87-cf50-48c5-89b7-9ce3d74cb66e None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:02.256755 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:02.323327 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab6fb87-cf50-48c5-89b7-9ce3d74cb66e None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:02.355565 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b3673-d923-45cf-9519-1fe3c56c6de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:02.356182 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b3673-d923-45cf-9519-1fe3c56c6de8 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:02.356720 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b3673-d923-45cf-9519-1fe3c56c6de8 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:02.356991 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b3673-d923-45cf-9519-1fe3c56c6de8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:02.367378 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b3673-d923-45cf-9519-1fe3c56c6de8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:02.368808 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69b3673-d923-45cf-9519-1fe3c56c6de8 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:02.382856 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-f69b3673-d923-45cf-9519-1fe3c56c6de8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:44:02.382856 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:44:02.382856 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:44:02.382856 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:44:02.382856 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:44:02.382856 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:44:02.382856 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:44:02.382856 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:44:02.382856 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:44:02.382856 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:44:02.382856 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:44:02.382856 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:44:02.382856 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:44:02.382856 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:44:02.382856 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:44:02.382856 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:44:02.383826 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:44:02.383826 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:44:02.383826 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:44:02.383826 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:44:02.383826 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:44:02.383826 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:44:02.383826 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:44:02.383826 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:44:02.383826 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:44:02.383826 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:44:02.383826 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:44:02.383826 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:44:02.383826 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:44:02.383826 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:44:02.383826 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:44:02.383826 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:44:02.383826 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:44:02.384719 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:44:02.384719 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:44:02.384719 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:44:02.384719 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 422/829] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:44:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:44:02.389649 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14c1b3-8f1f-4fb9-9b9a-4a4b317f8cb8 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:02.445846 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:02.466889 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b3673-d923-45cf-9519-1fe3c56c6de8 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:02.487596 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14c1b3-8f1f-4fb9-9b9a-4a4b317f8cb8 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:02.520990 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b4cf16-8790-48ab-9b19-b146085cc293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:02.521650 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4cf16-8790-48ab-9b19-b146085cc293 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:02.521934 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4cf16-8790-48ab-9b19-b146085cc293 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:02.522235 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4cf16-8790-48ab-9b19-b146085cc293 None admin] PATH_INFO: `/v3/domains` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:02.522876 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b4cf16-8790-48ab-9b19-b146085cc293 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:44:02.523174 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b4cf16-8790-48ab-9b19-b146085cc293 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:02.524545 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b4cf16-8790-48ab-9b19-b146085cc293 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:02.536722 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 408/830] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:44:02.542233 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b4cf16-8790-48ab-9b19-b146085cc293 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:02.552172 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:02.573320 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b3673-d923-45cf-9519-1fe3c56c6de8 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:02.606672 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f4666-0d9d-4713-8673-b240172708d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:02.607236 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f4666-0d9d-4713-8673-b240172708d8 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:02.607516 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f4666-0d9d-4713-8673-b240172708d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:02.607786 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f4666-0d9d-4713-8673-b240172708d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:02.618358 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f4666-0d9d-4713-8673-b240172708d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:44:02.623142 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-ca1f4666-0d9d-4713-8673-b240172708d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:44:02.623142 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:44:02.623142 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:44:02.623142 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:44:02.623142 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:44:02.623142 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:44:02.623142 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:44:02.623142 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:44:02.623142 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:44:02.623142 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:44:02.623142 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:44:02.623142 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:44:02.623142 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:44:02.623142 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:44:02.623142 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:44:02.623142 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:44:02.624162 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:44:02.624162 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:44:02.624162 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:44:02.624162 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:44:02.624162 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:44:02.624162 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:44:02.624162 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:44:02.624162 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:44:02.624162 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:44:02.624162 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:44:02.624162 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:44:02.624162 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:44:02.624162 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:44:02.624162 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:44:02.624162 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:44:02.624162 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:44:02.625022 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:44:02.625022 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:44:02.625022 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:44:02.625022 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:44:02.625022 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:44:02.625022 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:44:02.625022 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:44:02.625022 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:44:02.625022 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:44:02.625022 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:44:02.625022 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:44:02.625022 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:44:02.625022 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 423/831] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 23 00:44:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:44:02.630559 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f4666-0d9d-4713-8673-b240172708d8 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:02.641241 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b4cf16-8790-48ab-9b19-b146085cc293 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:02.658155 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:02.677028 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76ddd3-ba95-4ce0-9734-6519db14bffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:02.677971 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76ddd3-ba95-4ce0-9734-6519db14bffd None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:02.677971 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76ddd3-ba95-4ce0-9734-6519db14bffd None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:02.678246 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76ddd3-ba95-4ce0-9734-6519db14bffd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:02.684789 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76ddd3-ba95-4ce0-9734-6519db14bffd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:02.686321 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76ddd3-ba95-4ce0-9734-6519db14bffd None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:02.697312 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-dc76ddd3-ba95-4ce0-9734-6519db14bffd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:44:02.697312 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:44:02.697312 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:44:02.697312 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:44:02.697312 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:44:02.697312 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:44:02.697312 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:44:02.697312 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:44:02.697312 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:44:02.697312 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:44:02.697312 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:44:02.697312 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:44:02.697312 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 00:44:02.697312 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 00:44:02.697312 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 00:44:02.698319 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 00:44:02.698319 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:44:02.698319 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:44:02.698319 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:44:02.698319 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:44:02.698319 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:44:02.698319 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:44:02.698319 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:44:02.698319 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:44:02.698319 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:44:02.698319 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:44:02.698319 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:44:02.698319 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:44:02.698319 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:44:02.698319 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:44:02.698319 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:44:02.698319 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:44:02.699535 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 00:44:02.699535 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 00:44:02.699535 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 00:44:02.699535 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 00:44:02.699535 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 00:44:02.699535 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 00:44:02.699535 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:44:02.699535 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:44:02.699535 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 409/832] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 23 00:44:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:44:02.704081 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76ddd3-ba95-4ce0-9734-6519db14bffd None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:02.733526 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f4666-0d9d-4713-8673-b240172708d8 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:02.767802 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880afd03-b69b-4c04-be56-66c9ab51bc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:02.768399 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880afd03-b69b-4c04-be56-66c9ab51bc39 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:02.768684 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880afd03-b69b-4c04-be56-66c9ab51bc39 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:02.768951 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880afd03-b69b-4c04-be56-66c9ab51bc39 None admin] PATH_INFO: `/v3/roles` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:02.770146 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880afd03-b69b-4c04-be56-66c9ab51bc39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:44:02.770452 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880afd03-b69b-4c04-be56-66c9ab51bc39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:02.771825 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880afd03-b69b-4c04-be56-66c9ab51bc39 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:02.780133 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 424/833] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 23 00:44:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:44:02.786455 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880afd03-b69b-4c04-be56-66c9ab51bc39 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:02.790287 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:02.802667 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76ddd3-ba95-4ce0-9734-6519db14bffd None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:02.835913 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713920de-3419-45f5-bfd9-9b21351b7573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:02.836518 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713920de-3419-45f5-bfd9-9b21351b7573 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:02.836796 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713920de-3419-45f5-bfd9-9b21351b7573 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:02.837070 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713920de-3419-45f5-bfd9-9b21351b7573 None admin] PATH_INFO: `/v3/projects` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:02.837763 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713920de-3419-45f5-bfd9-9b21351b7573 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:44:02.838090 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713920de-3419-45f5-bfd9-9b21351b7573 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:02.839551 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713920de-3419-45f5-bfd9-9b21351b7573 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:02.851894 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 410/834] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 23 00:44:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:44:02.858207 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713920de-3419-45f5-bfd9-9b21351b7573 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:02.886269 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880afd03-b69b-4c04-be56-66c9ab51bc39 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:02.895578 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:02.920400 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8a556-a46f-4524-8fa2-c96c795bb02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:02.921018 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8a556-a46f-4524-8fa2-c96c795bb02f None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:02.921295 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8a556-a46f-4524-8fa2-c96c795bb02f None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:02.921564 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8a556-a46f-4524-8fa2-c96c795bb02f None admin] PATH_INFO: `/v3/users/ecba98e2e96c44b9b6c4524b853c8b89` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:02.922689 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b8a556-a46f-4524-8fa2-c96c795bb02f None admin] RBAC: Authorizing `identity:get_user(user_id=ecba98e2e96c44b9b6c4524b853c8b89)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:02.924115 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b8a556-a46f-4524-8fa2-c96c795bb02f None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:02.925833 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 425/835] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 23 00:44:02 2022] GET /identity/v3/users/ecba98e2e96c44b9b6c4524b853c8b89 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:44:02.931510 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8a556-a46f-4524-8fa2-c96c795bb02f None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:02.956137 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713920de-3419-45f5-bfd9-9b21351b7573 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:02.989978 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12beab02-5520-42d8-b0cb-01e037c10f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:02.990689 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12beab02-5520-42d8-b0cb-01e037c10f0a None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:02.990873 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12beab02-5520-42d8-b0cb-01e037c10f0a None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:02.991142 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12beab02-5520-42d8-b0cb-01e037c10f0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:02.991849 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12beab02-5520-42d8-b0cb-01e037c10f0a None admin] RBAC: Adding query filter params (role.id=e1cc8c321c304deaa299e74b57532d98, scope.project.id=60f8594760e44ce3888a32702ea9afcc, user.id=90f691140a8341ada73a8c6f01ad798c) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:44:02.992155 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12beab02-5520-42d8-b0cb-01e037c10f0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:02.993596 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12beab02-5520-42d8-b0cb-01e037c10f0a None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:02.999061 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:02.999447 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 411/836] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 23 00:44:02 2022] GET /identity/v3/role_assignments?user.id=90f691140a8341ada73a8c6f01ad798c&scope.project.id=60f8594760e44ce3888a32702ea9afcc&role.id=e1cc8c321c304deaa299e74b57532d98 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:44:03.039838 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8a556-a46f-4524-8fa2-c96c795bb02f None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:03.075382 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739353a9-121c-4718-8d66-f165a9a78486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:03.075996 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739353a9-121c-4718-8d66-f165a9a78486 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:03.076272 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739353a9-121c-4718-8d66-f165a9a78486 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:03.076540 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739353a9-121c-4718-8d66-f165a9a78486 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:03.147698 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739353a9-121c-4718-8d66-f165a9a78486 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:03.149175 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739353a9-121c-4718-8d66-f165a9a78486 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:03.217123 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:03.250476 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 426/837] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 23 00:44:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 23 00:44:03.256703 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12beab02-5520-42d8-b0cb-01e037c10f0a None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:03.358916 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12beab02-5520-42d8-b0cb-01e037c10f0a None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:03.360429 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:03.395417 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf8582-0c1a-400f-aae1-00fe2d989144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:03.396042 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf8582-0c1a-400f-aae1-00fe2d989144 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:03.398176 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf8582-0c1a-400f-aae1-00fe2d989144 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:03.398176 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf8582-0c1a-400f-aae1-00fe2d989144 None admin] PATH_INFO: `/v3/projects/65be930fe50a46cb801f4bd36e349034` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:03.398176 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf8582-0c1a-400f-aae1-00fe2d989144 None admin] RBAC: Authorizing `identity:get_project(project_id=65be930fe50a46cb801f4bd36e349034)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:03.399095 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf8582-0c1a-400f-aae1-00fe2d989144 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:03.400805 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 412/838] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 23 00:44:03 2022] GET /identity/v3/projects/65be930fe50a46cb801f4bd36e349034 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:44:03.407051 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739353a9-121c-4718-8d66-f165a9a78486 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:03.506940 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739353a9-121c-4718-8d66-f165a9a78486 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:03.540470 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52941540-309e-4aba-8e95-144cbd58ff7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:03.541065 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52941540-309e-4aba-8e95-144cbd58ff7b None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:03.541341 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52941540-309e-4aba-8e95-144cbd58ff7b None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:03.541610 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52941540-309e-4aba-8e95-144cbd58ff7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:03.542463 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52941540-309e-4aba-8e95-144cbd58ff7b None admin] RBAC: Adding query filter params (role.id=1e2073be75174689aa4fac29e674583d, scope.project.id=65be930fe50a46cb801f4bd36e349034, user.id=ecba98e2e96c44b9b6c4524b853c8b89) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:44:03.542762 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52941540-309e-4aba-8e95-144cbd58ff7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:03.544175 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52941540-309e-4aba-8e95-144cbd58ff7b None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:03.550811 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 427/839] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 23 00:44:03 2022] GET /identity/v3/role_assignments?user.id=ecba98e2e96c44b9b6c4524b853c8b89&scope.project.id=65be930fe50a46cb801f4bd36e349034&role.id=1e2073be75174689aa4fac29e674583d => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:44:05.707018 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c9a4c-bc61-4f3b-bf73-434f85838bab None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:05.707576 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c9a4c-bc61-4f3b-bf73-434f85838bab None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:05.707576 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c9a4c-bc61-4f3b-bf73-434f85838bab None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:05.708910 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 413/840] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:44:05.714141 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ffddd-30d6-43fd-843a-2e0060820b42 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:05.714555 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ffddd-30d6-43fd-843a-2e0060820b42 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:05.714676 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ffddd-30d6-43fd-843a-2e0060820b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:05.733002 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-ed4ffddd-30d6-43fd-843a-2e0060820b42 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:44:05.734195 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-ed4ffddd-30d6-43fd-843a-2e0060820b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:44:05.761281 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:05.798431 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 428/841] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:44:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:44:06.067782 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c9a4c-bc61-4f3b-bf73-434f85838bab None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:06.165027 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c9a4c-bc61-4f3b-bf73-434f85838bab None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:06.196624 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612570d-f892-42c6-b96a-551fe3b72c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:06.197219 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612570d-f892-42c6-b96a-551fe3b72c34 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:06.197490 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612570d-f892-42c6-b96a-551fe3b72c34 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:06.197753 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612570d-f892-42c6-b96a-551fe3b72c34 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:06.198849 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f612570d-f892-42c6-b96a-551fe3b72c34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:06.200256 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f612570d-f892-42c6-b96a-551fe3b72c34 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:06.201764 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 414/842] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:44:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:44:06.207872 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ffddd-30d6-43fd-843a-2e0060820b42 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:06.302379 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ffddd-30d6-43fd-843a-2e0060820b42 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:06.335035 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8db173-ba4c-4a36-898d-138b023eea2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:06.335565 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8db173-ba4c-4a36-898d-138b023eea2d None admin] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:06.335840 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8db173-ba4c-4a36-898d-138b023eea2d None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:06.336107 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8db173-ba4c-4a36-898d-138b023eea2d None admin] PATH_INFO: `/v3/users` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:06.336739 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8db173-ba4c-4a36-898d-138b023eea2d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:06.338171 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8db173-ba4c-4a36-898d-138b023eea2d None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:06.358405 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 429/843] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 23 00:44:06 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:44:08.496704 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cdc7d3-7c51-486d-992d-61811c5c0a08 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:08.497202 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cdc7d3-7c51-486d-992d-61811c5c0a08 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:08.497202 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cdc7d3-7c51-486d-992d-61811c5c0a08 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:08.498527 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 415/844] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:44:08.503581 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12097888-0c09-4e77-bab3-ef5e481e5bae None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:08.503998 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12097888-0c09-4e77-bab3-ef5e481e5bae None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:08.504123 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12097888-0c09-4e77-bab3-ef5e481e5bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:08.521624 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-12097888-0c09-4e77-bab3-ef5e481e5bae None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:44:08.522816 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-12097888-0c09-4e77-bab3-ef5e481e5bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:44:08.538962 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:08.587742 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 430/845] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:44:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:44:08.857362 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cdc7d3-7c51-486d-992d-61811c5c0a08 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:08.896638 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:08.959257 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cdc7d3-7c51-486d-992d-61811c5c0a08 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:08.991024 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766114e-cc67-4ac2-b92a-7ad73c680e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:08.991629 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766114e-cc67-4ac2-b92a-7ad73c680e71 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:08.991902 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766114e-cc67-4ac2-b92a-7ad73c680e71 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:08.992167 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766114e-cc67-4ac2-b92a-7ad73c680e71 None admin] PATH_INFO: `/v3/roles/9f802c7a3366414c9d0ee9e7a4cb5b74` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:08.993521 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e766114e-cc67-4ac2-b92a-7ad73c680e71 None admin] RBAC: Authorizing `identity:get_role(role_id=9f802c7a3366414c9d0ee9e7a4cb5b74)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:08.994906 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e766114e-cc67-4ac2-b92a-7ad73c680e71 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:08.996199 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 416/846] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 23 00:44:08 2022] GET /identity/v3/roles/9f802c7a3366414c9d0ee9e7a4cb5b74 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:44:09.001922 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12097888-0c09-4e77-bab3-ef5e481e5bae None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:09.097170 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12097888-0c09-4e77-bab3-ef5e481e5bae None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:09.130043 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09eb38-923b-4ee5-8efc-16cf130f0a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:09.130684 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09eb38-923b-4ee5-8efc-16cf130f0a9d None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:09.130961 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09eb38-923b-4ee5-8efc-16cf130f0a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:09.131231 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09eb38-923b-4ee5-8efc-16cf130f0a9d None admin] PATH_INFO: `/v3/users/715b568125904e9a889019291230bb03` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:09.143570 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09eb38-923b-4ee5-8efc-16cf130f0a9d None admin] RBAC: Authorizing `identity:get_user(user_id=715b568125904e9a889019291230bb03)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:09.145570 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09eb38-923b-4ee5-8efc-16cf130f0a9d None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:09.147163 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 431/847] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 23 00:44:09 2022] GET /identity/v3/users/715b568125904e9a889019291230bb03 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:44:09.152818 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766114e-cc67-4ac2-b92a-7ad73c680e71 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:09.247460 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766114e-cc67-4ac2-b92a-7ad73c680e71 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:09.254675 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:09.280743 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc261e95-a3fb-4cde-8c00-c43c1d38a3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:09.281351 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc261e95-a3fb-4cde-8c00-c43c1d38a3c0 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:09.281627 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc261e95-a3fb-4cde-8c00-c43c1d38a3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:09.281890 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc261e95-a3fb-4cde-8c00-c43c1d38a3c0 None admin] PATH_INFO: `/v3/projects/65be930fe50a46cb801f4bd36e349034` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:09.283002 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc261e95-a3fb-4cde-8c00-c43c1d38a3c0 None admin] RBAC: Authorizing `identity:get_project(project_id=65be930fe50a46cb801f4bd36e349034)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:09.284413 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc261e95-a3fb-4cde-8c00-c43c1d38a3c0 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:09.286021 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 417/848] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 23 00:44:09 2022] GET /identity/v3/projects/65be930fe50a46cb801f4bd36e349034 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:44:09.292013 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09eb38-923b-4ee5-8efc-16cf130f0a9d None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:09.304552 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:09.389191 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09eb38-923b-4ee5-8efc-16cf130f0a9d None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:09.420872 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a44c36-2012-4067-a8f8-48e94c019910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:09.421509 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a44c36-2012-4067-a8f8-48e94c019910 None admin] REQUEST_METHOD: `PUT` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:09.421784 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a44c36-2012-4067-a8f8-48e94c019910 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:09.422055 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a44c36-2012-4067-a8f8-48e94c019910 None admin] PATH_INFO: `/v3/projects/65be930fe50a46cb801f4bd36e349034/users/715b568125904e9a889019291230bb03/roles/9f802c7a3366414c9d0ee9e7a4cb5b74` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:09.424168 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a44c36-2012-4067-a8f8-48e94c019910 None admin] RBAC: Authorizing `identity:create_grant(project_id=65be930fe50a46cb801f4bd36e349034, user_id=715b568125904e9a889019291230bb03, role_id=9f802c7a3366414c9d0ee9e7a4cb5b74)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:09.426131 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a44c36-2012-4067-a8f8-48e94c019910 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:09.438200 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 432/849] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 23 00:44:09 2022] PUT /identity/v3/projects/65be930fe50a46cb801f4bd36e349034/users/715b568125904e9a889019291230bb03/roles/9f802c7a3366414c9d0ee9e7a4cb5b74 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:44:11.533533 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a016585-f6b0-4928-8b28-cbcc434ac6ee None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:11.534040 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a016585-f6b0-4928-8b28-cbcc434ac6ee None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:11.534040 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a016585-f6b0-4928-8b28-cbcc434ac6ee None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:11.535397 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 418/850] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:44:11.540661 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ccee2-e6b8-4130-a90d-c413608a4211 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:11.541037 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ccee2-e6b8-4130-a90d-c413608a4211 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:11.541211 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ccee2-e6b8-4130-a90d-c413608a4211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:11.558874 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-a79ccee2-e6b8-4130-a90d-c413608a4211 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:44:11.560047 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-a79ccee2-e6b8-4130-a90d-c413608a4211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:44:11.620256 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:11.625035 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 433/851] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:44:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:44:11.893866 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a016585-f6b0-4928-8b28-cbcc434ac6ee None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:11.992438 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a016585-f6b0-4928-8b28-cbcc434ac6ee None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:12.024395 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e97e3-54e5-44f3-8d89-3875cadffcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:12.025004 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e97e3-54e5-44f3-8d89-3875cadffcb1 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:12.025283 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e97e3-54e5-44f3-8d89-3875cadffcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:12.025552 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e97e3-54e5-44f3-8d89-3875cadffcb1 None admin] PATH_INFO: `/v3/roles/9f802c7a3366414c9d0ee9e7a4cb5b74` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:12.026949 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e97e3-54e5-44f3-8d89-3875cadffcb1 None admin] RBAC: Authorizing `identity:get_role(role_id=9f802c7a3366414c9d0ee9e7a4cb5b74)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:12.028329 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e97e3-54e5-44f3-8d89-3875cadffcb1 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:12.029631 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 419/852] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 23 00:44:11 2022] GET /identity/v3/roles/9f802c7a3366414c9d0ee9e7a4cb5b74 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:44:12.035882 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ccee2-e6b8-4130-a90d-c413608a4211 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:12.131082 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ccee2-e6b8-4130-a90d-c413608a4211 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:12.164453 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db36d2-78f9-4b0a-85cf-688ba2f942ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:12.165010 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db36d2-78f9-4b0a-85cf-688ba2f942ef None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:12.165289 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db36d2-78f9-4b0a-85cf-688ba2f942ef None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:12.165559 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db36d2-78f9-4b0a-85cf-688ba2f942ef None admin] PATH_INFO: `/v3/users/715b568125904e9a889019291230bb03` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:12.166675 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19db36d2-78f9-4b0a-85cf-688ba2f942ef None admin] RBAC: Authorizing `identity:get_user(user_id=715b568125904e9a889019291230bb03)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:12.168094 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19db36d2-78f9-4b0a-85cf-688ba2f942ef None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:12.169633 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 434/853] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 23 00:44:12 2022] GET /identity/v3/users/715b568125904e9a889019291230bb03 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:44:12.175051 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e97e3-54e5-44f3-8d89-3875cadffcb1 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:12.216644 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:12.271644 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e97e3-54e5-44f3-8d89-3875cadffcb1 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:12.304069 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db76cf-618e-436d-9442-a7e15ea16951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:12.304656 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db76cf-618e-436d-9442-a7e15ea16951 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:12.304935 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db76cf-618e-436d-9442-a7e15ea16951 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:12.305202 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db76cf-618e-436d-9442-a7e15ea16951 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:12.368865 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db76cf-618e-436d-9442-a7e15ea16951 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:12.370321 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db76cf-618e-436d-9442-a7e15ea16951 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:12.408676 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:12.462877 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 420/854] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 23 00:44:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 23 00:44:12.468827 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db36d2-78f9-4b0a-85cf-688ba2f942ef None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:12.532740 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:12.565400 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db36d2-78f9-4b0a-85cf-688ba2f942ef None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:12.598362 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7ab0d-349b-412d-bf89-8eaa01b8d028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:12.598971 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7ab0d-349b-412d-bf89-8eaa01b8d028 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:12.599248 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7ab0d-349b-412d-bf89-8eaa01b8d028 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:12.599520 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7ab0d-349b-412d-bf89-8eaa01b8d028 None admin] PATH_INFO: `/v3/projects/65be930fe50a46cb801f4bd36e349034` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:12.600620 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d7ab0d-349b-412d-bf89-8eaa01b8d028 None admin] RBAC: Authorizing `identity:get_project(project_id=65be930fe50a46cb801f4bd36e349034)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:12.602043 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d7ab0d-349b-412d-bf89-8eaa01b8d028 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:12.603674 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 435/855] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 23 00:44:12 2022] GET /identity/v3/projects/65be930fe50a46cb801f4bd36e349034 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:44:12.610069 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db76cf-618e-436d-9442-a7e15ea16951 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:12.702525 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db76cf-618e-436d-9442-a7e15ea16951 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:12.735286 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce11d3-4ad9-4aa1-9cf0-039124e6dd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:12.735805 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce11d3-4ad9-4aa1-9cf0-039124e6dd73 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:12.736081 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce11d3-4ad9-4aa1-9cf0-039124e6dd73 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:12.736349 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce11d3-4ad9-4aa1-9cf0-039124e6dd73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:12.737057 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce11d3-4ad9-4aa1-9cf0-039124e6dd73 None admin] RBAC: Adding query filter params (role.id=9f802c7a3366414c9d0ee9e7a4cb5b74, scope.project.id=65be930fe50a46cb801f4bd36e349034, user.id=715b568125904e9a889019291230bb03) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:44:12.737358 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce11d3-4ad9-4aa1-9cf0-039124e6dd73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:12.738830 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce11d3-4ad9-4aa1-9cf0-039124e6dd73 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:12.744269 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 421/856] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 23 00:44:12 2022] GET /identity/v3/role_assignments?user.id=715b568125904e9a889019291230bb03&scope.project.id=65be930fe50a46cb801f4bd36e349034&role.id=9f802c7a3366414c9d0ee9e7a4cb5b74 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:44:14.868421 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f33f9-d926-4523-bd81-ec97ccc15fa1 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:14.868965 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f33f9-d926-4523-bd81-ec97ccc15fa1 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:14.868965 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f33f9-d926-4523-bd81-ec97ccc15fa1 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:14.870329 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 436/857] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:44:14.875578 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3da4d-5388-4d86-9429-efc1243aea99 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:14.875993 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3da4d-5388-4d86-9429-efc1243aea99 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:14.876134 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3da4d-5388-4d86-9429-efc1243aea99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:14.888741 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:14.894720 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-aca3da4d-5388-4d86-9429-efc1243aea99 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:44:14.895931 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-aca3da4d-5388-4d86-9429-efc1243aea99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:44:14.959381 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 422/858] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:44:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 00:44:15.225493 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f33f9-d926-4523-bd81-ec97ccc15fa1 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:15.324137 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f33f9-d926-4523-bd81-ec97ccc15fa1 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:15.357414 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89791e87-bfee-46f4-aed9-4c13b0a4bc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:15.358031 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89791e87-bfee-46f4-aed9-4c13b0a4bc33 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:15.358338 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89791e87-bfee-46f4-aed9-4c13b0a4bc33 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:15.358607 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89791e87-bfee-46f4-aed9-4c13b0a4bc33 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:15.359694 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89791e87-bfee-46f4-aed9-4c13b0a4bc33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:15.361120 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89791e87-bfee-46f4-aed9-4c13b0a4bc33 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:15.363199 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 437/859] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:44:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:44:15.368851 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3da4d-5388-4d86-9429-efc1243aea99 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:15.461844 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3da4d-5388-4d86-9429-efc1243aea99 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:15.493975 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932e5ba-d644-4b29-a1ad-9b621f2c8f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:15.494535 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932e5ba-d644-4b29-a1ad-9b621f2c8f68 None admin] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:15.494811 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932e5ba-d644-4b29-a1ad-9b621f2c8f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:15.495082 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932e5ba-d644-4b29-a1ad-9b621f2c8f68 None admin] PATH_INFO: `/v3/projects` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:15.495725 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d932e5ba-d644-4b29-a1ad-9b621f2c8f68 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:15.497129 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d932e5ba-d644-4b29-a1ad-9b621f2c8f68 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:15.502244 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:15.523258 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 423/860] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Oct 23 00:44:15 2022] POST /identity/v3/projects => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:44:17.668287 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ac73c-4c71-4e50-a81a-88f693f94013 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:17.668794 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ac73c-4c71-4e50-a81a-88f693f94013 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:17.668908 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ac73c-4c71-4e50-a81a-88f693f94013 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:17.670299 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 438/861] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:44:17.675555 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6bad1-82b1-4b3f-9dc9-0e55c320081f None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:17.675923 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6bad1-82b1-4b3f-9dc9-0e55c320081f None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:17.676110 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6bad1-82b1-4b3f-9dc9-0e55c320081f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:17.693760 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-d2b6bad1-82b1-4b3f-9dc9-0e55c320081f None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:44:17.694977 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-d2b6bad1-82b1-4b3f-9dc9-0e55c320081f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:44:17.760209 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 424/862] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:44:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:44:18.031129 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ac73c-4c71-4e50-a81a-88f693f94013 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:18.034939 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:18.130311 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ac73c-4c71-4e50-a81a-88f693f94013 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:18.163254 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a3f17b-1fd2-4765-a8be-e6ebb20715ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:18.163871 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3f17b-1fd2-4765-a8be-e6ebb20715ad None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:18.164153 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3f17b-1fd2-4765-a8be-e6ebb20715ad None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:18.164428 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3f17b-1fd2-4765-a8be-e6ebb20715ad None admin] PATH_INFO: `/v3/domains/default` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:18.165527 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a3f17b-1fd2-4765-a8be-e6ebb20715ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:18.166989 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a3f17b-1fd2-4765-a8be-e6ebb20715ad None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:18.168550 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 439/863] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:44:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:44:18.174198 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6bad1-82b1-4b3f-9dc9-0e55c320081f None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:18.269572 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6bad1-82b1-4b3f-9dc9-0e55c320081f None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:18.286702 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:18.303203 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce19db-badd-4daf-9abb-3db1782b0560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:18.303805 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce19db-badd-4daf-9abb-3db1782b0560 None admin] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:18.304086 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce19db-badd-4daf-9abb-3db1782b0560 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:18.304361 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce19db-badd-4daf-9abb-3db1782b0560 None admin] PATH_INFO: `/v3/users` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:18.305017 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce19db-badd-4daf-9abb-3db1782b0560 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:18.306468 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce19db-badd-4daf-9abb-3db1782b0560 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:18.328917 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 425/864] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 23 00:44:18 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:44:20.466245 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee72eb-e2b3-4943-821d-b225b82273f0 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:20.466769 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee72eb-e2b3-4943-821d-b225b82273f0 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:20.466769 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee72eb-e2b3-4943-821d-b225b82273f0 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:20.468139 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 440/865] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:44:20.473873 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd6354-8427-436c-8de6-e97572ea894c None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:20.474311 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd6354-8427-436c-8de6-e97572ea894c None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:20.474427 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd6354-8427-436c-8de6-e97572ea894c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:20.492824 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-83dd6354-8427-436c-8de6-e97572ea894c None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:44:20.493937 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-83dd6354-8427-436c-8de6-e97572ea894c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:44:20.556637 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 426/866] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:44:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 00:44:20.817948 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee72eb-e2b3-4943-821d-b225b82273f0 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:20.886807 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:20.916595 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee72eb-e2b3-4943-821d-b225b82273f0 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:20.949705 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff1c66-6ab8-446d-be6b-0c8f66e41b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:20.950347 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff1c66-6ab8-446d-be6b-0c8f66e41b7a None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:20.950627 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff1c66-6ab8-446d-be6b-0c8f66e41b7a None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:20.950896 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff1c66-6ab8-446d-be6b-0c8f66e41b7a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:20.961160 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ff1c66-6ab8-446d-be6b-0c8f66e41b7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:44:20.965973 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-f4ff1c66-6ab8-446d-be6b-0c8f66e41b7a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:44:20.965973 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:44:20.965973 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:44:20.965973 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:44:20.965973 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:44:20.965973 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:44:20.965973 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:44:20.965973 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:44:20.965973 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:44:20.965973 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:44:20.965973 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:44:20.965973 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:44:20.965973 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:44:20.965973 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:44:20.965973 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:44:20.965973 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:44:20.967064 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:44:20.967064 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:44:20.967064 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:44:20.967064 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:44:20.967064 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:44:20.967064 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:44:20.967064 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:44:20.967064 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:44:20.967064 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:44:20.967064 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:44:20.967064 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:44:20.967064 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:44:20.967064 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:44:20.967064 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:44:20.967064 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:44:20.967064 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:44:20.968008 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:44:20.968008 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:44:20.968008 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:44:20.968008 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:44:20.968008 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:44:20.968008 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:44:20.968008 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:44:20.968008 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:44:20.968008 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:44:20.968008 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:44:20.968008 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:44:20.968008 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:44:20.968008 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 441/867] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 23 00:44:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:44:20.973634 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd6354-8427-436c-8de6-e97572ea894c None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:21.067369 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd6354-8427-436c-8de6-e97572ea894c None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:21.069650 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:21.100690 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707372a6-a8c3-4c9f-b43d-8cf17ebff781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:21.101281 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707372a6-a8c3-4c9f-b43d-8cf17ebff781 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:21.101561 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707372a6-a8c3-4c9f-b43d-8cf17ebff781 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:21.101834 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707372a6-a8c3-4c9f-b43d-8cf17ebff781 None admin] PATH_INFO: `/v3/roles` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:21.102519 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707372a6-a8c3-4c9f-b43d-8cf17ebff781 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:44:21.102820 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707372a6-a8c3-4c9f-b43d-8cf17ebff781 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:21.104187 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707372a6-a8c3-4c9f-b43d-8cf17ebff781 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:21.112060 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 427/868] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 23 00:44:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:44:21.117789 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff1c66-6ab8-446d-be6b-0c8f66e41b7a None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:21.216895 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff1c66-6ab8-446d-be6b-0c8f66e41b7a None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:21.245101 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:21.250823 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decee076-0d97-4517-a037-51bcc607e3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:21.251446 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decee076-0d97-4517-a037-51bcc607e3ca None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:21.251723 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decee076-0d97-4517-a037-51bcc607e3ca None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:21.251995 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decee076-0d97-4517-a037-51bcc607e3ca None admin] PATH_INFO: `/v3/users/4d265039ec07490cbc3984c288d94583` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:21.265782 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decee076-0d97-4517-a037-51bcc607e3ca None admin] RBAC: Authorizing `identity:get_user(user_id=4d265039ec07490cbc3984c288d94583)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:21.267247 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decee076-0d97-4517-a037-51bcc607e3ca None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:21.269593 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 442/869] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 23 00:44:21 2022] GET /identity/v3/users/4d265039ec07490cbc3984c288d94583 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:44:21.275291 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707372a6-a8c3-4c9f-b43d-8cf17ebff781 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:21.370731 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707372a6-a8c3-4c9f-b43d-8cf17ebff781 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:21.403095 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aad73b-2c77-45f5-b933-3d6b9e7bfac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:21.403709 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aad73b-2c77-45f5-b933-3d6b9e7bfac9 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:21.403992 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aad73b-2c77-45f5-b933-3d6b9e7bfac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:21.404265 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aad73b-2c77-45f5-b933-3d6b9e7bfac9 None admin] PATH_INFO: `/v3/projects/d7c260aabdf1459396b3b6d77ee1f873` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:21.405369 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aad73b-2c77-45f5-b933-3d6b9e7bfac9 None admin] RBAC: Authorizing `identity:get_project(project_id=d7c260aabdf1459396b3b6d77ee1f873)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:21.406850 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aad73b-2c77-45f5-b933-3d6b9e7bfac9 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:21.408476 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 428/870] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 23 00:44:21 2022] GET /identity/v3/projects/d7c260aabdf1459396b3b6d77ee1f873 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:44:21.414607 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decee076-0d97-4517-a037-51bcc607e3ca None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:21.508157 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decee076-0d97-4517-a037-51bcc607e3ca None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:21.540891 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1d7e0-1d7f-4392-a0f3-fa0993c615ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:21.541520 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1d7e0-1d7f-4392-a0f3-fa0993c615ea None admin] REQUEST_METHOD: `PUT` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:21.541796 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1d7e0-1d7f-4392-a0f3-fa0993c615ea None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:21.542064 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1d7e0-1d7f-4392-a0f3-fa0993c615ea None admin] PATH_INFO: `/v3/projects/d7c260aabdf1459396b3b6d77ee1f873/users/4d265039ec07490cbc3984c288d94583/roles/1e2073be75174689aa4fac29e674583d` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:21.543938 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1d7e0-1d7f-4392-a0f3-fa0993c615ea None admin] RBAC: Authorizing `identity:create_grant(project_id=d7c260aabdf1459396b3b6d77ee1f873, user_id=4d265039ec07490cbc3984c288d94583, role_id=1e2073be75174689aa4fac29e674583d)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:21.545342 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1d7e0-1d7f-4392-a0f3-fa0993c615ea None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:21.557536 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 443/871] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 23 00:44:21 2022] PUT /identity/v3/projects/d7c260aabdf1459396b3b6d77ee1f873/users/4d265039ec07490cbc3984c288d94583/roles/1e2073be75174689aa4fac29e674583d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:44:23.651904 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391dc0d-f9c4-4354-9842-056700ecca7b None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:23.652422 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391dc0d-f9c4-4354-9842-056700ecca7b None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:23.652535 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391dc0d-f9c4-4354-9842-056700ecca7b None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:23.653778 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 429/872] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:44:23.658900 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f10021-b56e-42eb-a4a0-105b37c75886 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:23.659290 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f10021-b56e-42eb-a4a0-105b37c75886 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:23.660031 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f10021-b56e-42eb-a4a0-105b37c75886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:23.677634 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-18f10021-b56e-42eb-a4a0-105b37c75886 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:44:23.678835 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-18f10021-b56e-42eb-a4a0-105b37c75886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:44:23.723172 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:23.744941 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 444/873] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:44:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:44:24.013494 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391dc0d-f9c4-4354-9842-056700ecca7b None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:24.048195 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:24.112785 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391dc0d-f9c4-4354-9842-056700ecca7b None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:24.145161 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bed973-c10d-4e55-bb3e-6b2e994fb133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:24.145769 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bed973-c10d-4e55-bb3e-6b2e994fb133 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:24.146049 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bed973-c10d-4e55-bb3e-6b2e994fb133 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:24.146354 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bed973-c10d-4e55-bb3e-6b2e994fb133 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:24.156415 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bed973-c10d-4e55-bb3e-6b2e994fb133 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:44:24.161299 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-43bed973-c10d-4e55-bb3e-6b2e994fb133 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:44:24.161299 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:44:24.161299 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:44:24.161299 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:44:24.161299 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:44:24.161299 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:44:24.161299 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:44:24.161299 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:44:24.161299 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:44:24.161299 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:44:24.161299 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:44:24.161299 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:44:24.161299 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:44:24.161299 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:44:24.161299 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:44:24.161299 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:44:24.162433 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:44:24.162433 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:44:24.162433 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:44:24.162433 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:44:24.162433 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:44:24.162433 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:44:24.162433 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:44:24.162433 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:44:24.162433 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:44:24.162433 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:44:24.162433 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:44:24.162433 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:44:24.162433 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:44:24.162433 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:44:24.162433 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:44:24.162433 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:44:24.163481 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:44:24.163481 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:44:24.163481 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:44:24.163481 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:44:24.163481 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:44:24.163481 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:44:24.163481 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:44:24.163481 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:44:24.163481 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:44:24.163481 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:44:24.163481 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:44:24.163481 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:44:24.163481 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 430/874] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 23 00:44:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:44:24.168411 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f10021-b56e-42eb-a4a0-105b37c75886 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:24.263766 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f10021-b56e-42eb-a4a0-105b37c75886 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:24.296140 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddd417-0e67-4fb0-9643-178a87a2e72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:24.296737 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddd417-0e67-4fb0-9643-178a87a2e72f None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:24.297015 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddd417-0e67-4fb0-9643-178a87a2e72f None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:24.297285 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddd417-0e67-4fb0-9643-178a87a2e72f None admin] PATH_INFO: `/v3/roles` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:24.297938 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ddd417-0e67-4fb0-9643-178a87a2e72f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:44:24.298275 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ddd417-0e67-4fb0-9643-178a87a2e72f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:24.299637 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ddd417-0e67-4fb0-9643-178a87a2e72f None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:24.307357 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 445/875] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 23 00:44:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:44:24.313198 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bed973-c10d-4e55-bb3e-6b2e994fb133 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:24.403511 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:24.410298 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bed973-c10d-4e55-bb3e-6b2e994fb133 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:24.443135 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c29e17-d82f-46a3-9423-a1025db4b016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:24.443745 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c29e17-d82f-46a3-9423-a1025db4b016 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:24.444028 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c29e17-d82f-46a3-9423-a1025db4b016 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:24.444302 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c29e17-d82f-46a3-9423-a1025db4b016 None admin] PATH_INFO: `/v3/users/4d265039ec07490cbc3984c288d94583` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:24.445407 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c29e17-d82f-46a3-9423-a1025db4b016 None admin] RBAC: Authorizing `identity:get_user(user_id=4d265039ec07490cbc3984c288d94583)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:24.446917 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c29e17-d82f-46a3-9423-a1025db4b016 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:24.448470 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 431/876] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 23 00:44:24 2022] GET /identity/v3/users/4d265039ec07490cbc3984c288d94583 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:44:24.454232 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddd417-0e67-4fb0-9643-178a87a2e72f None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:24.496278 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:24.551617 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddd417-0e67-4fb0-9643-178a87a2e72f None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:24.583973 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06658fce-346e-4e05-affd-55cb3b85f3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:24.584563 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06658fce-346e-4e05-affd-55cb3b85f3d9 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:24.584845 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06658fce-346e-4e05-affd-55cb3b85f3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:24.585119 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06658fce-346e-4e05-affd-55cb3b85f3d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:24.650198 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06658fce-346e-4e05-affd-55cb3b85f3d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:24.651634 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06658fce-346e-4e05-affd-55cb3b85f3d9 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:24.692257 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:24.747849 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 446/877] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 23 00:44:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 23 00:44:24.754280 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c29e17-d82f-46a3-9423-a1025db4b016 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:24.850014 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c29e17-d82f-46a3-9423-a1025db4b016 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:24.882056 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3a407-8c11-4c00-b283-f1e140bb7e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:24.882685 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3a407-8c11-4c00-b283-f1e140bb7e66 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:24.882960 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3a407-8c11-4c00-b283-f1e140bb7e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:24.883227 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3a407-8c11-4c00-b283-f1e140bb7e66 None admin] PATH_INFO: `/v3/projects/d7c260aabdf1459396b3b6d77ee1f873` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:24.884305 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f3a407-8c11-4c00-b283-f1e140bb7e66 None admin] RBAC: Authorizing `identity:get_project(project_id=d7c260aabdf1459396b3b6d77ee1f873)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:24.885729 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f3a407-8c11-4c00-b283-f1e140bb7e66 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:24.887340 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 432/878] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 23 00:44:24 2022] GET /identity/v3/projects/d7c260aabdf1459396b3b6d77ee1f873 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:44:24.893245 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06658fce-346e-4e05-affd-55cb3b85f3d9 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:24.993169 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06658fce-346e-4e05-affd-55cb3b85f3d9 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:25.028029 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa894d-96c1-4807-81cd-9f3d51a33018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:25.028641 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa894d-96c1-4807-81cd-9f3d51a33018 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:25.028925 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa894d-96c1-4807-81cd-9f3d51a33018 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:25.029198 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa894d-96c1-4807-81cd-9f3d51a33018 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:25.029921 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa894d-96c1-4807-81cd-9f3d51a33018 None admin] RBAC: Adding query filter params (role.id=1e2073be75174689aa4fac29e674583d, scope.project.id=d7c260aabdf1459396b3b6d77ee1f873, user.id=4d265039ec07490cbc3984c288d94583) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:44:25.030266 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa894d-96c1-4807-81cd-9f3d51a33018 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:25.031697 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa894d-96c1-4807-81cd-9f3d51a33018 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:25.037517 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 447/879] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 23 00:44:24 2022] GET /identity/v3/role_assignments?user.id=4d265039ec07490cbc3984c288d94583&scope.project.id=d7c260aabdf1459396b3b6d77ee1f873&role.id=1e2073be75174689aa4fac29e674583d => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:44:27.177646 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2b8e9-ce0f-4f8e-8144-748eb38a92e6 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:27.178342 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2b8e9-ce0f-4f8e-8144-748eb38a92e6 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:27.178342 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2b8e9-ce0f-4f8e-8144-748eb38a92e6 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:27.179531 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 433/880] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:44:27.184650 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22666180-6b85-4f34-8085-16d4f8ea6c15 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:27.185018 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22666180-6b85-4f34-8085-16d4f8ea6c15 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:27.185240 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22666180-6b85-4f34-8085-16d4f8ea6c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:27.198427 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:27.203940 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-22666180-6b85-4f34-8085-16d4f8ea6c15 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:44:27.205130 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-22666180-6b85-4f34-8085-16d4f8ea6c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:44:27.272762 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 448/881] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:44:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:44:27.539094 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2b8e9-ce0f-4f8e-8144-748eb38a92e6 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:27.569606 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:27.637809 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2b8e9-ce0f-4f8e-8144-748eb38a92e6 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:27.669089 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd99fe1-5ffa-4c73-a55c-7de157bea1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:27.669668 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd99fe1-5ffa-4c73-a55c-7de157bea1dc None admin] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:27.669942 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd99fe1-5ffa-4c73-a55c-7de157bea1dc None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:27.670237 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd99fe1-5ffa-4c73-a55c-7de157bea1dc None admin] PATH_INFO: `/v3/domains` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:27.670898 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd99fe1-5ffa-4c73-a55c-7de157bea1dc None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:27.672234 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd99fe1-5ffa-4c73-a55c-7de157bea1dc None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:27.687128 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 434/882] 10.222.0.23 () {60 vars in 1138 bytes} [Sun Oct 23 00:44:27 2022] POST /identity/v3/domains => generated 267 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:44:29.839345 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968f9bf-7624-4315-afb3-09fe88cdc6fc None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:29.839970 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968f9bf-7624-4315-afb3-09fe88cdc6fc None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:29.839970 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968f9bf-7624-4315-afb3-09fe88cdc6fc None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:29.841216 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 449/883] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:44:29.847115 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46f6f3-cfd6-49a6-b313-cb18e80a4c08 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:29.847521 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46f6f3-cfd6-49a6-b313-cb18e80a4c08 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:29.847659 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46f6f3-cfd6-49a6-b313-cb18e80a4c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:29.865473 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-4e46f6f3-cfd6-49a6-b313-cb18e80a4c08 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:44:29.866675 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-4e46f6f3-cfd6-49a6-b313-cb18e80a4c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:44:29.930279 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 435/884] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:44:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 23 00:44:30.201108 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968f9bf-7624-4315-afb3-09fe88cdc6fc None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:30.300408 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968f9bf-7624-4315-afb3-09fe88cdc6fc None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:30.331916 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ae8de-f5ca-4864-b986-fa13a7abf696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:30.332523 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ae8de-f5ca-4864-b986-fa13a7abf696 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:30.332800 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ae8de-f5ca-4864-b986-fa13a7abf696 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:30.333068 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ae8de-f5ca-4864-b986-fa13a7abf696 None admin] PATH_INFO: `/v3/domains/350f6ce13ab44137842bff30fabad391` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:30.335648 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:30.344056 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2ae8de-f5ca-4864-b986-fa13a7abf696 None admin] RBAC: Authorizing `identity:get_domain(domain_id=350f6ce13ab44137842bff30fabad391)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:30.345483 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2ae8de-f5ca-4864-b986-fa13a7abf696 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:30.347607 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 450/885] 10.222.0.23 () {56 vars in 1183 bytes} [Sun Oct 23 00:44:30 2022] GET /identity/v3/domains/350f6ce13ab44137842bff30fabad391 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:44:30.353366 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46f6f3-cfd6-49a6-b313-cb18e80a4c08 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:30.374470 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:30.450143 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46f6f3-cfd6-49a6-b313-cb18e80a4c08 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:30.482343 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d7247-cfc1-4c17-a866-309a5dfc7a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:30.482866 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d7247-cfc1-4c17-a866-309a5dfc7a0f None admin] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:30.483147 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d7247-cfc1-4c17-a866-309a5dfc7a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:30.483415 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d7247-cfc1-4c17-a866-309a5dfc7a0f None admin] PATH_INFO: `/v3/projects` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:30.484063 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09d7247-cfc1-4c17-a866-309a5dfc7a0f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:30.485490 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09d7247-cfc1-4c17-a866-309a5dfc7a0f None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:30.511499 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 436/886] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Oct 23 00:44:30 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:44:32.649833 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521db35-20a8-4586-84f1-f317bd1ae64b None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:32.650396 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521db35-20a8-4586-84f1-f317bd1ae64b None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:32.650396 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521db35-20a8-4586-84f1-f317bd1ae64b None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:32.651760 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 451/887] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:44:32.657067 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d1a0c-c432-49e3-af83-6b307aa2c2d8 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:32.657480 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d1a0c-c432-49e3-af83-6b307aa2c2d8 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:32.657622 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d1a0c-c432-49e3-af83-6b307aa2c2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:32.675818 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-f37d1a0c-c432-49e3-af83-6b307aa2c2d8 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:44:32.676996 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-f37d1a0c-c432-49e3-af83-6b307aa2c2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:44:32.740458 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 437/888] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:44:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:44:33.007677 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521db35-20a8-4586-84f1-f317bd1ae64b None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:33.104801 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521db35-20a8-4586-84f1-f317bd1ae64b None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:33.136890 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e684b13c-b7e9-47a0-8057-02f89498e9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:33.137495 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684b13c-b7e9-47a0-8057-02f89498e9c3 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:33.137771 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684b13c-b7e9-47a0-8057-02f89498e9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:33.138038 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684b13c-b7e9-47a0-8057-02f89498e9c3 None admin] PATH_INFO: `/v3/domains/350f6ce13ab44137842bff30fabad391` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:33.139151 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e684b13c-b7e9-47a0-8057-02f89498e9c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=350f6ce13ab44137842bff30fabad391)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:33.140561 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e684b13c-b7e9-47a0-8057-02f89498e9c3 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:33.142106 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 452/889] 10.222.0.23 () {56 vars in 1183 bytes} [Sun Oct 23 00:44:33 2022] GET /identity/v3/domains/350f6ce13ab44137842bff30fabad391 => generated 267 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:44:33.147611 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d1a0c-c432-49e3-af83-6b307aa2c2d8 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:33.149765 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:33.244424 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37d1a0c-c432-49e3-af83-6b307aa2c2d8 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:33.277401 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5d6de-7abe-4feb-9062-73d1ca8b0b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:33.277938 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5d6de-7abe-4feb-9062-73d1ca8b0b50 None admin] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:33.278250 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5d6de-7abe-4feb-9062-73d1ca8b0b50 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:33.278529 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5d6de-7abe-4feb-9062-73d1ca8b0b50 None admin] PATH_INFO: `/v3/users` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:33.279170 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5d6de-7abe-4feb-9062-73d1ca8b0b50 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:33.280584 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5d6de-7abe-4feb-9062-73d1ca8b0b50 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:33.301658 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 438/890] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 23 00:44:33 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:44:35.434892 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e92268-a1e3-40f2-ba70-1f02bc2ec337 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:35.435458 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e92268-a1e3-40f2-ba70-1f02bc2ec337 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:35.435567 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e92268-a1e3-40f2-ba70-1f02bc2ec337 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:35.436838 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 453/891] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:44:35.442150 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46336342-03ec-49b6-90b8-2180b1fcbb66 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:35.442568 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46336342-03ec-49b6-90b8-2180b1fcbb66 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:35.442706 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46336342-03ec-49b6-90b8-2180b1fcbb66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:35.461047 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-46336342-03ec-49b6-90b8-2180b1fcbb66 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:44:35.462270 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-46336342-03ec-49b6-90b8-2180b1fcbb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:44:35.625835 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:35.640194 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 439/892] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:44:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:44:35.911732 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e92268-a1e3-40f2-ba70-1f02bc2ec337 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:35.973407 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:36.011539 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e92268-a1e3-40f2-ba70-1f02bc2ec337 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:36.043305 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d473690-a538-431c-963b-9a70d8d1964d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:36.043915 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d473690-a538-431c-963b-9a70d8d1964d None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:36.044191 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d473690-a538-431c-963b-9a70d8d1964d None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:36.044457 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d473690-a538-431c-963b-9a70d8d1964d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:36.054468 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d473690-a538-431c-963b-9a70d8d1964d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:44:36.059137 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-6d473690-a538-431c-963b-9a70d8d1964d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:44:36.059137 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:44:36.059137 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:44:36.059137 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:44:36.059137 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:44:36.059137 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:44:36.059137 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:44:36.059137 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:44:36.059137 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:44:36.059137 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:44:36.059137 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:44:36.059137 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:44:36.059137 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:44:36.059137 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:44:36.059137 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:44:36.059137 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:44:36.060275 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:44:36.060275 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:44:36.060275 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:44:36.060275 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:44:36.060275 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:44:36.060275 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:44:36.060275 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:44:36.060275 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:44:36.060275 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:44:36.060275 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:44:36.060275 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:44:36.060275 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:44:36.060275 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:44:36.060275 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:44:36.060275 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:44:36.060275 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:44:36.061183 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:44:36.061183 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:44:36.061183 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:44:36.061183 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:44:36.061183 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:44:36.061183 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:44:36.061183 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:44:36.061183 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:44:36.061183 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:44:36.061183 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:44:36.061183 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:44:36.061183 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:44:36.061183 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 454/893] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 23 00:44:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:44:36.066655 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46336342-03ec-49b6-90b8-2180b1fcbb66 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:36.160505 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46336342-03ec-49b6-90b8-2180b1fcbb66 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:36.192430 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98802f-314f-4f5c-bee3-dd53d740918d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:36.192954 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98802f-314f-4f5c-bee3-dd53d740918d None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:36.193228 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98802f-314f-4f5c-bee3-dd53d740918d None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:36.193496 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98802f-314f-4f5c-bee3-dd53d740918d None admin] PATH_INFO: `/v3/roles` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:36.194173 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa98802f-314f-4f5c-bee3-dd53d740918d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:44:36.194471 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa98802f-314f-4f5c-bee3-dd53d740918d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:36.195833 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa98802f-314f-4f5c-bee3-dd53d740918d None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:36.203409 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 440/894] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 23 00:44:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:44:36.209476 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d473690-a538-431c-963b-9a70d8d1964d None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:36.305713 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d473690-a538-431c-963b-9a70d8d1964d None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:36.328053 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:36.339779 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54fe0a2-161a-42d6-bff6-08d7ab0cc058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:36.340399 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fe0a2-161a-42d6-bff6-08d7ab0cc058 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:36.340687 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fe0a2-161a-42d6-bff6-08d7ab0cc058 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:36.340960 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fe0a2-161a-42d6-bff6-08d7ab0cc058 None admin] PATH_INFO: `/v3/users/9ee8f93a233d49938549d487357a0975` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:36.353866 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54fe0a2-161a-42d6-bff6-08d7ab0cc058 None admin] RBAC: Authorizing `identity:get_user(user_id=9ee8f93a233d49938549d487357a0975)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:36.355345 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54fe0a2-161a-42d6-bff6-08d7ab0cc058 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:36.357252 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 455/895] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 23 00:44:36 2022] GET /identity/v3/users/9ee8f93a233d49938549d487357a0975 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:44:36.363479 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98802f-314f-4f5c-bee3-dd53d740918d None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:36.411024 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:36.458780 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa98802f-314f-4f5c-bee3-dd53d740918d None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:36.490526 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd380c-3622-453b-a8f0-431e1f1c2d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:36.491128 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd380c-3622-453b-a8f0-431e1f1c2d81 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:36.491407 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd380c-3622-453b-a8f0-431e1f1c2d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:36.491676 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd380c-3622-453b-a8f0-431e1f1c2d81 None admin] PATH_INFO: `/v3/projects/ea47b30289f84a6497c9f6f521efb6a3` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:36.492765 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd380c-3622-453b-a8f0-431e1f1c2d81 None admin] RBAC: Authorizing `identity:get_project(project_id=ea47b30289f84a6497c9f6f521efb6a3)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:36.494208 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd380c-3622-453b-a8f0-431e1f1c2d81 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:36.495787 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 441/896] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 23 00:44:36 2022] GET /identity/v3/projects/ea47b30289f84a6497c9f6f521efb6a3 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:44:36.501492 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54fe0a2-161a-42d6-bff6-08d7ab0cc058 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:36.596232 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54fe0a2-161a-42d6-bff6-08d7ab0cc058 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:36.629262 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf43fe-dad5-4473-879e-93356cda83e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:36.629892 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf43fe-dad5-4473-879e-93356cda83e5 None admin] REQUEST_METHOD: `PUT` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:36.630195 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf43fe-dad5-4473-879e-93356cda83e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:36.630467 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf43fe-dad5-4473-879e-93356cda83e5 None admin] PATH_INFO: `/v3/projects/ea47b30289f84a6497c9f6f521efb6a3/users/9ee8f93a233d49938549d487357a0975/roles/1e2073be75174689aa4fac29e674583d` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:36.632319 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf43fe-dad5-4473-879e-93356cda83e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=ea47b30289f84a6497c9f6f521efb6a3, user_id=9ee8f93a233d49938549d487357a0975, role_id=1e2073be75174689aa4fac29e674583d)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:36.633730 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf43fe-dad5-4473-879e-93356cda83e5 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:36.645906 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 456/897] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 23 00:44:36 2022] PUT /identity/v3/projects/ea47b30289f84a6497c9f6f521efb6a3/users/9ee8f93a233d49938549d487357a0975/roles/1e2073be75174689aa4fac29e674583d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:44:38.796637 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6097232-e23b-4691-a0b7-00a27370a2b6 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:38.797189 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6097232-e23b-4691-a0b7-00a27370a2b6 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:38.797189 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6097232-e23b-4691-a0b7-00a27370a2b6 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:38.798549 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 442/898] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:44:38.805026 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3ced4-9f6c-46ab-8fbe-d9258f0af2b6 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:38.805599 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3ced4-9f6c-46ab-8fbe-d9258f0af2b6 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:38.805599 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3ced4-9f6c-46ab-8fbe-d9258f0af2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:38.823432 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-10a3ced4-9f6c-46ab-8fbe-d9258f0af2b6 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:44:38.824625 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-10a3ced4-9f6c-46ab-8fbe-d9258f0af2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:44:38.859780 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:38.890301 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 457/899] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:44:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:44:39.161006 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6097232-e23b-4691-a0b7-00a27370a2b6 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:39.258656 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6097232-e23b-4691-a0b7-00a27370a2b6 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:39.275435 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:39.291594 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87926b31-2147-416e-9cf1-16e822b46877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:39.292207 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87926b31-2147-416e-9cf1-16e822b46877 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:39.292489 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87926b31-2147-416e-9cf1-16e822b46877 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:39.292763 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87926b31-2147-416e-9cf1-16e822b46877 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:39.302437 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87926b31-2147-416e-9cf1-16e822b46877 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:44:39.307206 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-87926b31-2147-416e-9cf1-16e822b46877 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:44:39.307206 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:44:39.307206 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:44:39.307206 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:44:39.307206 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:44:39.307206 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:44:39.307206 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:44:39.307206 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:44:39.307206 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:44:39.307206 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:44:39.307206 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:44:39.307206 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:44:39.307206 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:44:39.307206 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:44:39.307206 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:44:39.307206 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:44:39.308339 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:44:39.308339 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:44:39.308339 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:44:39.308339 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:44:39.308339 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:44:39.308339 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:44:39.308339 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:44:39.308339 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:44:39.308339 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:44:39.308339 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:44:39.308339 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:44:39.308339 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:44:39.308339 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:44:39.308339 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:44:39.308339 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:44:39.308339 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:44:39.309206 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:44:39.309206 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:44:39.309206 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:44:39.309206 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:44:39.309206 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:44:39.309206 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:44:39.309206 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:44:39.309206 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:44:39.309206 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:44:39.309206 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:44:39.309206 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:44:39.309206 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:44:39.309206 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 443/900] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 23 00:44:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:44:39.314434 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a3ced4-9f6c-46ab-8fbe-d9258f0af2b6 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:39.409739 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a3ced4-9f6c-46ab-8fbe-d9258f0af2b6 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:39.442878 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2e013-eb6a-4f58-a2ae-6ba555725a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:39.443411 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2e013-eb6a-4f58-a2ae-6ba555725a6f None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:39.443692 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2e013-eb6a-4f58-a2ae-6ba555725a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:39.443968 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2e013-eb6a-4f58-a2ae-6ba555725a6f None admin] PATH_INFO: `/v3/roles` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:39.444622 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c2e013-eb6a-4f58-a2ae-6ba555725a6f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:44:39.444922 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c2e013-eb6a-4f58-a2ae-6ba555725a6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:39.446310 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c2e013-eb6a-4f58-a2ae-6ba555725a6f None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:39.453971 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 458/901] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 23 00:44:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:44:39.460349 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87926b31-2147-416e-9cf1-16e822b46877 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:39.554640 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87926b31-2147-416e-9cf1-16e822b46877 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:39.586802 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394c6fc-6fba-47cc-a4b1-f030bc85b66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:39.587408 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394c6fc-6fba-47cc-a4b1-f030bc85b66e None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:39.587685 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394c6fc-6fba-47cc-a4b1-f030bc85b66e None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:39.587956 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394c6fc-6fba-47cc-a4b1-f030bc85b66e None admin] PATH_INFO: `/v3/users/9ee8f93a233d49938549d487357a0975` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:39.589059 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e394c6fc-6fba-47cc-a4b1-f030bc85b66e None admin] RBAC: Authorizing `identity:get_user(user_id=9ee8f93a233d49938549d487357a0975)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:39.590507 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e394c6fc-6fba-47cc-a4b1-f030bc85b66e None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:39.592041 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 444/902] 10.222.0.23 () {56 vars in 1177 bytes} [Sun Oct 23 00:44:39 2022] GET /identity/v3/users/9ee8f93a233d49938549d487357a0975 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:44:39.597538 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2e013-eb6a-4f58-a2ae-6ba555725a6f None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:39.631604 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:39.695449 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2e013-eb6a-4f58-a2ae-6ba555725a6f None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:39.727094 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f758b-b878-43cd-9bd2-9ce17c11f5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:39.727681 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f758b-b878-43cd-9bd2-9ce17c11f5f3 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:39.727961 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f758b-b878-43cd-9bd2-9ce17c11f5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:39.728231 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f758b-b878-43cd-9bd2-9ce17c11f5f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:39.793041 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f758b-b878-43cd-9bd2-9ce17c11f5f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:39.794576 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f758b-b878-43cd-9bd2-9ce17c11f5f3 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:39.827717 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:39.892745 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 459/903] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 23 00:44:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 23 00:44:39.899296 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394c6fc-6fba-47cc-a4b1-f030bc85b66e None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:39.944329 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:39.994889 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394c6fc-6fba-47cc-a4b1-f030bc85b66e None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:40.027603 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716997a-88d6-48b2-b967-1200a386ef67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:40.028212 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716997a-88d6-48b2-b967-1200a386ef67 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:40.028489 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716997a-88d6-48b2-b967-1200a386ef67 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:40.028759 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716997a-88d6-48b2-b967-1200a386ef67 None admin] PATH_INFO: `/v3/projects/ea47b30289f84a6497c9f6f521efb6a3` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:40.029853 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b716997a-88d6-48b2-b967-1200a386ef67 None admin] RBAC: Authorizing `identity:get_project(project_id=ea47b30289f84a6497c9f6f521efb6a3)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:40.031295 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b716997a-88d6-48b2-b967-1200a386ef67 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:40.032876 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 445/904] 10.222.0.23 () {56 vars in 1186 bytes} [Sun Oct 23 00:44:39 2022] GET /identity/v3/projects/ea47b30289f84a6497c9f6f521efb6a3 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:44:40.039359 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f758b-b878-43cd-9bd2-9ce17c11f5f3 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:44:40.134292 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f758b-b878-43cd-9bd2-9ce17c11f5f3 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:44:40.167425 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf74f9-e6ef-4287-a17d-57a9539446d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:44:40.168012 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf74f9-e6ef-4287-a17d-57a9539446d2 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:44:40.168290 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf74f9-e6ef-4287-a17d-57a9539446d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:44:40.168559 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf74f9-e6ef-4287-a17d-57a9539446d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:44:40.169268 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf74f9-e6ef-4287-a17d-57a9539446d2 None admin] RBAC: Adding query filter params (role.id=1e2073be75174689aa4fac29e674583d, scope.project.id=ea47b30289f84a6497c9f6f521efb6a3, user.id=9ee8f93a233d49938549d487357a0975) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:44:40.169569 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf74f9-e6ef-4287-a17d-57a9539446d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:44:40.171009 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf74f9-e6ef-4287-a17d-57a9539446d2 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:44:40.172722 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:40.177926 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 460/905] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 23 00:44:40 2022] GET /identity/v3/role_assignments?user.id=9ee8f93a233d49938549d487357a0975&scope.project.id=ea47b30289f84a6497c9f6f521efb6a3&role.id=1e2073be75174689aa4fac29e674583d => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:44:50.023582 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=43 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:44:50.175952 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=1 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:45:35.020007 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a034e-720e-4c7c-a2a6-061b16b9c417 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:35.020600 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a034e-720e-4c7c-a2a6-061b16b9c417 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:35.020600 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a034e-720e-4c7c-a2a6-061b16b9c417 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:35.021874 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 446/906] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:45:35.027510 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f7a57-5e0e-4ffe-b2d7-f53194a09b64 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:35.027991 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f7a57-5e0e-4ffe-b2d7-f53194a09b64 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:35.028102 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f7a57-5e0e-4ffe-b2d7-f53194a09b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:35.050836 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-777f7a57-5e0e-4ffe-b2d7-f53194a09b64 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:45:35.050836 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-777f7a57-5e0e-4ffe-b2d7-f53194a09b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:45:35.137738 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 461/907] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:45:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:45:35.416529 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a034e-720e-4c7c-a2a6-061b16b9c417 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:35.546183 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a034e-720e-4c7c-a2a6-061b16b9c417 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:35.598769 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34eb4d5-d231-4412-b0e6-8b96cac352f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:35.599783 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34eb4d5-d231-4412-b0e6-8b96cac352f0 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:35.600278 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34eb4d5-d231-4412-b0e6-8b96cac352f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:35.600759 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34eb4d5-d231-4412-b0e6-8b96cac352f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:35.612876 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34eb4d5-d231-4412-b0e6-8b96cac352f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:45:35.615468 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34eb4d5-d231-4412-b0e6-8b96cac352f0 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:45:35.636607 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-f34eb4d5-d231-4412-b0e6-8b96cac352f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:45:35.636607 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:45:35.636607 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:45:35.636607 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:45:35.636607 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:45:35.636607 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:45:35.636607 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:45:35.636607 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:45:35.636607 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:45:35.636607 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:45:35.636607 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:45:35.636607 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:45:35.636607 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:45:35.636607 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:45:35.636607 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:45:35.636607 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:45:35.637718 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:45:35.637718 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:45:35.637718 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:45:35.637718 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:45:35.637718 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:45:35.637718 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:45:35.637718 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:45:35.637718 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:45:35.637718 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:45:35.637718 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:45:35.637718 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:45:35.637718 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:45:35.637718 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:45:35.637718 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:45:35.637718 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:45:35.637718 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:45:35.637718 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:45:35.638797 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:45:35.638797 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:45:35.638797 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:45:35.638797 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 447/908] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:45:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:45:35.644673 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f7a57-5e0e-4ffe-b2d7-f53194a09b64 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:35.765439 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f7a57-5e0e-4ffe-b2d7-f53194a09b64 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:35.803770 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:45:35.811236 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dcb1fd-ce69-44fc-8c9a-e124e1fdbeaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:35.812470 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcb1fd-ce69-44fc-8c9a-e124e1fdbeaa None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:35.812822 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcb1fd-ce69-44fc-8c9a-e124e1fdbeaa None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:35.813095 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcb1fd-ce69-44fc-8c9a-e124e1fdbeaa None admin] PATH_INFO: `/v3/domains` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:35.813745 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dcb1fd-ce69-44fc-8c9a-e124e1fdbeaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:45:35.814100 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dcb1fd-ce69-44fc-8c9a-e124e1fdbeaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:45:35.815448 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dcb1fd-ce69-44fc-8c9a-e124e1fdbeaa None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:45:35.830114 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 462/909] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:45:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:45:35.833811 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34eb4d5-d231-4412-b0e6-8b96cac352f0 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:35.900223 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:45:35.963942 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34eb4d5-d231-4412-b0e6-8b96cac352f0 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:36.018707 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafff9d4-afe3-4b5d-9552-7d98a1bd3dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:36.019895 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafff9d4-afe3-4b5d-9552-7d98a1bd3dc2 None admin] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:36.020674 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafff9d4-afe3-4b5d-9552-7d98a1bd3dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:36.022062 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafff9d4-afe3-4b5d-9552-7d98a1bd3dc2 None admin] PATH_INFO: `/v3/users` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:36.022889 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafff9d4-afe3-4b5d-9552-7d98a1bd3dc2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:45:36.024858 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafff9d4-afe3-4b5d-9552-7d98a1bd3dc2 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:45:36.054135 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 448/910] 10.222.0.23 () {60 vars in 1132 bytes} [Sun Oct 23 00:45:35 2022] POST /identity/v3/users => generated 251 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:45:38.604979 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0807465-f2ae-451e-ae6e-78c4004c2c62 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:38.605502 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0807465-f2ae-451e-ae6e-78c4004c2c62 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:38.605502 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0807465-f2ae-451e-ae6e-78c4004c2c62 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:38.607250 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 463/911] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:45:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:45:38.617371 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ca062-6882-4a4e-9089-70e3db3d36c4 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:38.617871 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ca062-6882-4a4e-9089-70e3db3d36c4 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:38.617957 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ca062-6882-4a4e-9089-70e3db3d36c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:38.637433 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-796ca062-6882-4a4e-9089-70e3db3d36c4 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:45:38.639412 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-796ca062-6882-4a4e-9089-70e3db3d36c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:45:38.721061 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 449/912] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:45:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:45:39.050344 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0807465-f2ae-451e-ae6e-78c4004c2c62 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:39.164219 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0807465-f2ae-451e-ae6e-78c4004c2c62 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:39.202290 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76deab-3d29-46fa-98ea-2afe7976cae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:39.202929 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76deab-3d29-46fa-98ea-2afe7976cae9 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:39.203210 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76deab-3d29-46fa-98ea-2afe7976cae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:39.203483 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76deab-3d29-46fa-98ea-2afe7976cae9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:39.215364 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a76deab-3d29-46fa-98ea-2afe7976cae9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:45:39.221113 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-4a76deab-3d29-46fa-98ea-2afe7976cae9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:45:39.221113 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:45:39.221113 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:45:39.221113 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:45:39.221113 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:45:39.221113 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:45:39.221113 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:45:39.221113 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:45:39.221113 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:45:39.221113 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:45:39.221113 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:45:39.221113 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:45:39.221113 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:45:39.221113 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:45:39.221113 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:45:39.221113 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:45:39.227642 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:45:39.227642 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:45:39.227642 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:45:39.227642 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:45:39.227642 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:45:39.227642 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:45:39.227642 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:45:39.227642 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:45:39.227642 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:45:39.227642 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:45:39.227642 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:45:39.227642 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:45:39.227642 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:45:39.227642 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:45:39.227642 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:45:39.227642 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:45:39.228996 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:45:39.228996 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:45:39.228996 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:45:39.228996 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:45:39.228996 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:45:39.228996 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:45:39.228996 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:45:39.228996 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:45:39.228996 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:45:39.228996 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:45:39.228996 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:45:39.228996 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:45:39.228996 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 464/913] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 23 00:45:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:45:39.229985 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ca062-6882-4a4e-9089-70e3db3d36c4 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:39.275252 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:45:39.341274 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ca062-6882-4a4e-9089-70e3db3d36c4 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:39.389199 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ab84c-bcca-482b-be7b-2eacaec216ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:39.390069 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ab84c-bcca-482b-be7b-2eacaec216ed None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:39.390481 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ab84c-bcca-482b-be7b-2eacaec216ed None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:39.390960 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ab84c-bcca-482b-be7b-2eacaec216ed None admin] PATH_INFO: `/v3/roles` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:39.391876 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ab84c-bcca-482b-be7b-2eacaec216ed None admin] RBAC: Adding query filter params (name=service) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:45:39.392257 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ab84c-bcca-482b-be7b-2eacaec216ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:45:39.393748 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ab84c-bcca-482b-be7b-2eacaec216ed None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:45:39.403755 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 450/914] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Oct 23 00:45:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:45:39.411340 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76deab-3d29-46fa-98ea-2afe7976cae9 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:39.467725 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:45:39.529110 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76deab-3d29-46fa-98ea-2afe7976cae9 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:39.575005 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca04e3-37e6-4311-8e46-5a7131059310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:39.575837 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca04e3-37e6-4311-8e46-5a7131059310 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:39.576113 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca04e3-37e6-4311-8e46-5a7131059310 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:39.576390 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca04e3-37e6-4311-8e46-5a7131059310 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:39.590244 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca04e3-37e6-4311-8e46-5a7131059310 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:45:39.591805 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca04e3-37e6-4311-8e46-5a7131059310 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:45:39.609402 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-10ca04e3-37e6-4311-8e46-5a7131059310 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:45:39.609402 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:45:39.609402 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:45:39.609402 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:45:39.609402 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:45:39.609402 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:45:39.609402 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:45:39.609402 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:45:39.609402 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:45:39.609402 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:45:39.609402 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:45:39.609402 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:45:39.609402 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:45:39.609402 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:45:39.609402 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:45:39.609402 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:45:39.615747 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:45:39.615747 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:45:39.615747 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:45:39.615747 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:45:39.615747 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:45:39.615747 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:45:39.615747 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:45:39.615747 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:45:39.615747 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:45:39.615747 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:45:39.615747 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:45:39.615747 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:45:39.615747 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:45:39.615747 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:45:39.615747 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:45:39.615747 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:45:39.615747 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:45:39.616856 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:45:39.616856 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:45:39.616856 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:45:39.616856 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 465/915] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:45:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:45:39.617150 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ab84c-bcca-482b-be7b-2eacaec216ed None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:39.722216 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:45:39.725024 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ab84c-bcca-482b-be7b-2eacaec216ed None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:39.760896 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb15d3-b885-4c6f-9a79-256600f323b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:39.761494 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb15d3-b885-4c6f-9a79-256600f323b4 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:39.761771 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb15d3-b885-4c6f-9a79-256600f323b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:39.762042 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb15d3-b885-4c6f-9a79-256600f323b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:39.762706 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb15d3-b885-4c6f-9a79-256600f323b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:45:39.763006 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb15d3-b885-4c6f-9a79-256600f323b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:45:39.764371 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb15d3-b885-4c6f-9a79-256600f323b4 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:45:39.776217 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 451/916] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:45:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:45:39.782621 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca04e3-37e6-4311-8e46-5a7131059310 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:39.891282 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca04e3-37e6-4311-8e46-5a7131059310 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:39.892867 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:45:39.935287 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb18db9-b846-4c32-a0a0-6db94fa7b785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:39.935878 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb18db9-b846-4c32-a0a0-6db94fa7b785 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:39.936158 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb18db9-b846-4c32-a0a0-6db94fa7b785 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:39.936482 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb18db9-b846-4c32-a0a0-6db94fa7b785 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:39.946406 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb18db9-b846-4c32-a0a0-6db94fa7b785 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:45:39.948145 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb18db9-b846-4c32-a0a0-6db94fa7b785 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:45:39.961474 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-afb18db9-b846-4c32-a0a0-6db94fa7b785 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 23 00:45:39.961474 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:45:39.961474 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:45:39.961474 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:45:39.961474 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:45:39.961474 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:45:39.961474 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:45:39.961474 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:45:39.961474 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:45:39.961474 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:45:39.961474 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:45:39.961474 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:45:39.961474 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 00:45:39.961474 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 00:45:39.961474 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 00:45:39.961474 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 00:45:39.962944 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:45:39.962944 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:45:39.962944 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:45:39.962944 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:45:39.962944 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:45:39.962944 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:45:39.962944 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:45:39.962944 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:45:39.962944 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:45:39.962944 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:45:39.962944 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:45:39.962944 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:45:39.962944 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:45:39.962944 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:45:39.962944 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:45:39.962944 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:45:39.962944 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:45:39.962944 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:45:39.964411 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:45:39.964411 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:45:39.964411 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 00:45:39.964411 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 00:45:39.964411 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 00:45:39.964411 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 00:45:39.964411 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 00:45:39.964411 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 00:45:39.964411 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 23 00:45:39.964411 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:45:39.968518 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 466/917] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:45:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:45:39.969324 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb15d3-b885-4c6f-9a79-256600f323b4 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:40.080350 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb15d3-b885-4c6f-9a79-256600f323b4 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:40.117523 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8f1c8-031e-40ba-a62a-ec3f7aa23cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:40.118142 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8f1c8-031e-40ba-a62a-ec3f7aa23cca None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:40.118421 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8f1c8-031e-40ba-a62a-ec3f7aa23cca None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:40.118701 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8f1c8-031e-40ba-a62a-ec3f7aa23cca None admin] PATH_INFO: `/v3/users` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:40.119408 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8f1c8-031e-40ba-a62a-ec3f7aa23cca None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:45:40.119707 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8f1c8-031e-40ba-a62a-ec3f7aa23cca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:45:40.121118 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8f1c8-031e-40ba-a62a-ec3f7aa23cca None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:45:40.138493 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 452/918] 10.222.0.23 () {56 vars in 1143 bytes} [Sun Oct 23 00:45:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:45:40.144963 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb18db9-b846-4c32-a0a0-6db94fa7b785 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:40.264066 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb18db9-b846-4c32-a0a0-6db94fa7b785 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:40.304067 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0fbce-4fe8-4395-b3a1-ffaf14f38ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:40.305129 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0fbce-4fe8-4395-b3a1-ffaf14f38ea7 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:40.305677 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0fbce-4fe8-4395-b3a1-ffaf14f38ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:40.306274 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0fbce-4fe8-4395-b3a1-ffaf14f38ea7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:40.318680 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0fbce-4fe8-4395-b3a1-ffaf14f38ea7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:45:40.320125 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0fbce-4fe8-4395-b3a1-ffaf14f38ea7 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:45:40.335582 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-25d0fbce-4fe8-4395-b3a1-ffaf14f38ea7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:45:40.335582 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:45:40.335582 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:45:40.335582 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:45:40.335582 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:45:40.335582 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:45:40.335582 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:45:40.335582 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:45:40.335582 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:45:40.335582 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:45:40.335582 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:45:40.335582 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:45:40.335582 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:45:40.335582 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:45:40.335582 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:45:40.335582 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:45:40.336745 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:45:40.336745 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:45:40.336745 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:45:40.336745 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:45:40.336745 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:45:40.336745 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:45:40.336745 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:45:40.336745 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:45:40.336745 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:45:40.336745 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:45:40.336745 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:45:40.336745 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:45:40.336745 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:45:40.336745 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:45:40.336745 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:45:40.336745 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:45:40.336745 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:45:40.337642 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:45:40.337642 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:45:40.337642 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:45:40.337642 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 467/919] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:45:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:45:40.343490 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8f1c8-031e-40ba-a62a-ec3f7aa23cca None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:40.366238 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:45:40.465596 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8f1c8-031e-40ba-a62a-ec3f7aa23cca None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:40.505372 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d1fef-f770-4aa5-9f0b-0bc1a02735a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:40.506341 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d1fef-f770-4aa5-9f0b-0bc1a02735a0 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:40.506817 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d1fef-f770-4aa5-9f0b-0bc1a02735a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:40.507267 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d1fef-f770-4aa5-9f0b-0bc1a02735a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:40.508090 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5d1fef-f770-4aa5-9f0b-0bc1a02735a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:45:40.508566 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5d1fef-f770-4aa5-9f0b-0bc1a02735a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:45:40.510122 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5d1fef-f770-4aa5-9f0b-0bc1a02735a0 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:45:40.523573 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 453/920] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:45:40.529590 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0fbce-4fe8-4395-b3a1-ffaf14f38ea7 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:40.547741 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:45:40.655477 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0fbce-4fe8-4395-b3a1-ffaf14f38ea7 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:40.695309 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80320381-fb90-4b18-b761-69eded20159d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:40.695957 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80320381-fb90-4b18-b761-69eded20159d None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:40.696246 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80320381-fb90-4b18-b761-69eded20159d None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:40.696554 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80320381-fb90-4b18-b761-69eded20159d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:40.705578 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80320381-fb90-4b18-b761-69eded20159d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:45:40.707211 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80320381-fb90-4b18-b761-69eded20159d None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:45:40.721150 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-80320381-fb90-4b18-b761-69eded20159d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:45:40.721150 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:45:40.721150 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:45:40.721150 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:45:40.721150 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:45:40.721150 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:45:40.721150 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:45:40.721150 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:45:40.721150 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:45:40.721150 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:45:40.721150 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:45:40.721150 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:45:40.721150 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 00:45:40.721150 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 00:45:40.721150 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 00:45:40.722304 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 00:45:40.722304 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:45:40.722304 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:45:40.722304 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:45:40.722304 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:45:40.722304 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:45:40.722304 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:45:40.722304 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:45:40.722304 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:45:40.722304 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:45:40.722304 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:45:40.722304 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:45:40.722304 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:45:40.722304 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:45:40.722304 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:45:40.722304 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:45:40.722304 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:45:40.723336 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 00:45:40.723336 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 00:45:40.723336 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 00:45:40.723336 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 00:45:40.723336 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 00:45:40.723336 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 00:45:40.723336 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:45:40.723336 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:45:40.723336 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 468/921] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 23 00:45:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:45:40.728745 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d1fef-f770-4aa5-9f0b-0bc1a02735a0 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:40.817224 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:45:40.840747 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d1fef-f770-4aa5-9f0b-0bc1a02735a0 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:40.878622 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc730787-a35c-4707-b356-f6183b2638cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:40.879334 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc730787-a35c-4707-b356-f6183b2638cb None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:40.879621 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc730787-a35c-4707-b356-f6183b2638cb None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:40.879907 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc730787-a35c-4707-b356-f6183b2638cb None admin] PATH_INFO: `/v3/projects` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:40.880635 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc730787-a35c-4707-b356-f6183b2638cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:45:40.881001 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc730787-a35c-4707-b356-f6183b2638cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:45:40.882547 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc730787-a35c-4707-b356-f6183b2638cb None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:45:40.895795 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 454/922] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 23 00:45:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:45:40.902192 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80320381-fb90-4b18-b761-69eded20159d None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:40.992057 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:45:41.021104 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80320381-fb90-4b18-b761-69eded20159d None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:41.064728 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7963d-4d15-42bf-8a85-5e5a266c40e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:41.065418 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7963d-4d15-42bf-8a85-5e5a266c40e2 None admin] REQUEST_METHOD: `PUT` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:41.065698 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7963d-4d15-42bf-8a85-5e5a266c40e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:41.065976 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7963d-4d15-42bf-8a85-5e5a266c40e2 None admin] PATH_INFO: `/v3/projects/60f8594760e44ce3888a32702ea9afcc/users/1863d19ad4624ea496c2c73b70ae0c6e/roles/832e4b25a75c4d30a010d6803a5a4577` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:41.086759 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7963d-4d15-42bf-8a85-5e5a266c40e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=60f8594760e44ce3888a32702ea9afcc, user_id=1863d19ad4624ea496c2c73b70ae0c6e, role_id=832e4b25a75c4d30a010d6803a5a4577)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:45:41.088373 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7963d-4d15-42bf-8a85-5e5a266c40e2 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:45:41.101272 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 469/923] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 23 00:45:40 2022] PUT /identity/v3/projects/60f8594760e44ce3888a32702ea9afcc/users/1863d19ad4624ea496c2c73b70ae0c6e/roles/832e4b25a75c4d30a010d6803a5a4577 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:45:43.299481 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd59ab-e9b3-4cb2-af35-e6664acc5ea8 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:43.300066 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd59ab-e9b3-4cb2-af35-e6664acc5ea8 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:43.300066 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd59ab-e9b3-4cb2-af35-e6664acc5ea8 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:43.301393 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 455/924] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:45:43.306942 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453352a-2fde-433a-b496-3f670a85f545 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:43.307419 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453352a-2fde-433a-b496-3f670a85f545 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:43.307523 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453352a-2fde-433a-b496-3f670a85f545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:43.324950 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-3453352a-2fde-433a-b496-3f670a85f545 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:45:43.326171 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-3453352a-2fde-433a-b496-3f670a85f545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:45:43.394496 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 470/925] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:45:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:45:43.678999 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd59ab-e9b3-4cb2-af35-e6664acc5ea8 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:43.786618 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd59ab-e9b3-4cb2-af35-e6664acc5ea8 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:43.823097 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c658c-9f41-457b-b992-89d2699419b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:43.824414 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c658c-9f41-457b-b992-89d2699419b4 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:43.824414 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c658c-9f41-457b-b992-89d2699419b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:43.824414 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c658c-9f41-457b-b992-89d2699419b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:43.833102 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:45:43.838480 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c658c-9f41-457b-b992-89d2699419b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:45:43.844241 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-a84c658c-9f41-457b-b992-89d2699419b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:45:43.844241 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:45:43.844241 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:45:43.844241 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:45:43.844241 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:45:43.844241 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:45:43.844241 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:45:43.844241 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:45:43.844241 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:45:43.844241 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:45:43.844241 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:45:43.844241 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:45:43.844241 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:45:43.844241 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:45:43.844241 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:45:43.844241 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:45:43.845348 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:45:43.845348 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:45:43.845348 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:45:43.845348 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:45:43.845348 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:45:43.845348 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:45:43.845348 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:45:43.845348 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:45:43.845348 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:45:43.845348 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:45:43.845348 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:45:43.845348 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:45:43.845348 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:45:43.845348 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:45:43.845348 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:45:43.845348 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:45:43.846667 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:45:43.846667 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:45:43.846667 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:45:43.846667 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:45:43.846667 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:45:43.846667 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:45:43.846667 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:45:43.846667 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:45:43.846667 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:45:43.846667 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:45:43.846667 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 23 00:45:43.846667 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:45:43.846667 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 456/926] 10.222.0.23 () {56 vars in 1102 bytes} [Sun Oct 23 00:45:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:45:43.851394 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453352a-2fde-433a-b496-3f670a85f545 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:43.911101 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:45:43.964802 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453352a-2fde-433a-b496-3f670a85f545 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:44.002754 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d4266-9484-4037-a104-008ec850a158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:44.003372 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d4266-9484-4037-a104-008ec850a158 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:44.003694 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d4266-9484-4037-a104-008ec850a158 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:44.003995 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d4266-9484-4037-a104-008ec850a158 None admin] PATH_INFO: `/v3/roles` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:44.004673 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d4266-9484-4037-a104-008ec850a158 None admin] RBAC: Adding query filter params (name=service) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:45:44.004975 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d4266-9484-4037-a104-008ec850a158 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:45:44.006393 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d4266-9484-4037-a104-008ec850a158 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:45:44.015080 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 471/927] 10.222.0.23 () {56 vars in 1103 bytes} [Sun Oct 23 00:45:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:45:44.021059 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c658c-9f41-457b-b992-89d2699419b4 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:44.140923 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c658c-9f41-457b-b992-89d2699419b4 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:44.177629 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e601b-24f0-48c0-b929-b532cd2ec39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:44.178285 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e601b-24f0-48c0-b929-b532cd2ec39e None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:44.178561 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e601b-24f0-48c0-b929-b532cd2ec39e None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:44.178895 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e601b-24f0-48c0-b929-b532cd2ec39e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:44.189969 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e601b-24f0-48c0-b929-b532cd2ec39e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:45:44.191749 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e601b-24f0-48c0-b929-b532cd2ec39e None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:45:44.207193 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-612e601b-24f0-48c0-b929-b532cd2ec39e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:45:44.207193 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:45:44.207193 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:45:44.207193 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:45:44.207193 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:45:44.207193 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:45:44.207193 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:45:44.207193 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:45:44.207193 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:45:44.207193 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:45:44.207193 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:45:44.207193 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:45:44.207193 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:45:44.207193 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:45:44.207193 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:45:44.207193 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:45:44.208332 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:45:44.208332 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:45:44.208332 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:45:44.208332 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:45:44.208332 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:45:44.208332 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:45:44.208332 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:45:44.208332 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:45:44.208332 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:45:44.208332 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:45:44.208332 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:45:44.208332 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:45:44.208332 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:45:44.208332 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:45:44.208332 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:45:44.208332 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:45:44.208332 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:45:44.209580 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:45:44.209580 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:45:44.209580 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:45:44.209580 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 457/928] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:45:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:45:44.214120 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d4266-9484-4037-a104-008ec850a158 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:44.321216 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d4266-9484-4037-a104-008ec850a158 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:44.338405 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:45:44.357565 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f73ef-f365-4e6d-bd28-51691acf14b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:44.358234 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f73ef-f365-4e6d-bd28-51691acf14b0 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:44.358521 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f73ef-f365-4e6d-bd28-51691acf14b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:44.358801 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f73ef-f365-4e6d-bd28-51691acf14b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:44.359460 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f73ef-f365-4e6d-bd28-51691acf14b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:45:44.359753 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f73ef-f365-4e6d-bd28-51691acf14b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:45:44.361127 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f73ef-f365-4e6d-bd28-51691acf14b0 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:45:44.373127 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 472/929] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:45:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:45:44.379700 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e601b-24f0-48c0-b929-b532cd2ec39e None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:44.436990 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:45:44.494607 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e601b-24f0-48c0-b929-b532cd2ec39e None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:44.532450 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245ba67-0a1f-4915-8950-b8cc3be5f27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:44.533083 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245ba67-0a1f-4915-8950-b8cc3be5f27c None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:44.533365 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245ba67-0a1f-4915-8950-b8cc3be5f27c None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:44.533643 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245ba67-0a1f-4915-8950-b8cc3be5f27c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:44.541662 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9245ba67-0a1f-4915-8950-b8cc3be5f27c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:45:44.543120 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9245ba67-0a1f-4915-8950-b8cc3be5f27c None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:45:44.555274 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-9245ba67-0a1f-4915-8950-b8cc3be5f27c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 23 00:45:44.555274 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:45:44.555274 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:45:44.555274 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:45:44.555274 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:45:44.555274 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:45:44.555274 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:45:44.555274 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:45:44.555274 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:45:44.555274 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:45:44.555274 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:45:44.555274 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:45:44.555274 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 00:45:44.555274 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 00:45:44.555274 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 00:45:44.555274 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 00:45:44.556661 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:45:44.556661 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:45:44.556661 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:45:44.556661 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:45:44.556661 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:45:44.556661 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:45:44.556661 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:45:44.556661 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:45:44.556661 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:45:44.556661 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:45:44.556661 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:45:44.556661 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:45:44.556661 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:45:44.556661 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:45:44.556661 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:45:44.556661 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:45:44.556661 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:45:44.556661 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:45:44.558124 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:45:44.558124 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:45:44.558124 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 00:45:44.558124 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 00:45:44.558124 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 00:45:44.558124 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 00:45:44.558124 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 00:45:44.558124 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 00:45:44.558124 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 23 00:45:44.558124 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:45:44.558124 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 458/930] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:45:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:45:44.563108 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f73ef-f365-4e6d-bd28-51691acf14b0 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:44.674563 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f73ef-f365-4e6d-bd28-51691acf14b0 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:44.714287 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091ebd2-09f4-4cb9-9fd3-768223497d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:44.715023 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091ebd2-09f4-4cb9-9fd3-768223497d66 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:44.715301 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091ebd2-09f4-4cb9-9fd3-768223497d66 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:44.715572 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091ebd2-09f4-4cb9-9fd3-768223497d66 None admin] PATH_INFO: `/v3/users` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:44.716290 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091ebd2-09f4-4cb9-9fd3-768223497d66 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:45:44.716592 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091ebd2-09f4-4cb9-9fd3-768223497d66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:45:44.718168 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091ebd2-09f4-4cb9-9fd3-768223497d66 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:45:44.737762 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 473/931] 10.222.0.23 () {56 vars in 1143 bytes} [Sun Oct 23 00:45:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:45:44.743606 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245ba67-0a1f-4915-8950-b8cc3be5f27c None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:44.851254 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245ba67-0a1f-4915-8950-b8cc3be5f27c None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:44.863961 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:45:44.890175 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9aa3c-3d10-40c3-9f09-0de6b247e13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:44.890773 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9aa3c-3d10-40c3-9f09-0de6b247e13e None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:44.891049 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9aa3c-3d10-40c3-9f09-0de6b247e13e None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:44.891317 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9aa3c-3d10-40c3-9f09-0de6b247e13e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:44.969942 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca9aa3c-3d10-40c3-9f09-0de6b247e13e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:45:44.971984 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca9aa3c-3d10-40c3-9f09-0de6b247e13e None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:45:45.087743 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 459/932] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 23 00:45:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 23 00:45:45.094643 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091ebd2-09f4-4cb9-9fd3-768223497d66 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:45.132418 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:45:45.207475 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091ebd2-09f4-4cb9-9fd3-768223497d66 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:45.247340 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6536af7f-25ea-4e47-8a90-b63351fbb808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:45.247972 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536af7f-25ea-4e47-8a90-b63351fbb808 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:45.248250 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536af7f-25ea-4e47-8a90-b63351fbb808 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:45.248559 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536af7f-25ea-4e47-8a90-b63351fbb808 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:45.258875 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6536af7f-25ea-4e47-8a90-b63351fbb808 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:45:45.260343 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6536af7f-25ea-4e47-8a90-b63351fbb808 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:45:45.275245 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-6536af7f-25ea-4e47-8a90-b63351fbb808 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:45:45.275245 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:45:45.275245 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:45:45.275245 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:45:45.275245 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:45:45.275245 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:45:45.275245 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:45:45.275245 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:45:45.275245 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:45:45.275245 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:45:45.275245 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:45:45.275245 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:45:45.275245 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:45:45.275245 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:45:45.275245 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:45:45.275245 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:45:45.276385 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:45:45.276385 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:45:45.276385 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:45:45.276385 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:45:45.276385 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:45:45.276385 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:45:45.276385 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:45:45.276385 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:45:45.276385 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:45:45.276385 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:45:45.276385 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:45:45.276385 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:45:45.276385 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:45:45.276385 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:45:45.276385 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:45:45.276385 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:45:45.276385 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:45:45.277520 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:45:45.277520 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:45:45.277520 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:45:45.281765 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 474/933] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:45:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:45:45.282741 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9aa3c-3d10-40c3-9f09-0de6b247e13e None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:45.295162 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:45:45.385724 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9aa3c-3d10-40c3-9f09-0de6b247e13e None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:45.422281 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700dc5c-9a9f-49d1-bd01-4b71b1fe0715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:45.422886 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700dc5c-9a9f-49d1-bd01-4b71b1fe0715 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:45.423162 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700dc5c-9a9f-49d1-bd01-4b71b1fe0715 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:45.423433 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700dc5c-9a9f-49d1-bd01-4b71b1fe0715 None admin] PATH_INFO: `/v3/domains` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:45.424070 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6700dc5c-9a9f-49d1-bd01-4b71b1fe0715 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:45:45.424387 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6700dc5c-9a9f-49d1-bd01-4b71b1fe0715 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:45:45.425730 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6700dc5c-9a9f-49d1-bd01-4b71b1fe0715 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:45:45.442562 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 460/934] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:45:45.443878 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6536af7f-25ea-4e47-8a90-b63351fbb808 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:45.534710 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:45:45.550895 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6536af7f-25ea-4e47-8a90-b63351fbb808 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:45.586178 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf64f2-4f17-4eed-9a6f-578f904a8717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:45.586812 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf64f2-4f17-4eed-9a6f-578f904a8717 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:45.587099 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf64f2-4f17-4eed-9a6f-578f904a8717 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:45.587373 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf64f2-4f17-4eed-9a6f-578f904a8717 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:45.595005 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf64f2-4f17-4eed-9a6f-578f904a8717 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:45:45.596587 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf64f2-4f17-4eed-9a6f-578f904a8717 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:45:45.609683 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-1dcf64f2-4f17-4eed-9a6f-578f904a8717 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:45:45.609683 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:45:45.609683 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:45:45.609683 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:45:45.609683 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:45:45.609683 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:45:45.609683 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:45:45.609683 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:45:45.609683 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:45:45.609683 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:45:45.609683 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:45:45.609683 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:45:45.609683 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 00:45:45.609683 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 00:45:45.609683 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 00:45:45.610806 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 00:45:45.610806 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:45:45.610806 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:45:45.610806 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:45:45.610806 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:45:45.610806 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:45:45.610806 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:45:45.610806 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:45:45.610806 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:45:45.610806 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:45:45.610806 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:45:45.610806 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:45:45.610806 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:45:45.610806 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:45:45.610806 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:45:45.610806 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:45:45.610806 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:45:45.611956 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 00:45:45.611956 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 00:45:45.611956 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 00:45:45.611956 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 00:45:45.611956 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 00:45:45.611956 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 00:45:45.611956 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:45:45.611956 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:45:45.611956 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 475/935] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 23 00:45:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:45:45.617781 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700dc5c-9a9f-49d1-bd01-4b71b1fe0715 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:45.692364 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:45:45.725099 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700dc5c-9a9f-49d1-bd01-4b71b1fe0715 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:45.760165 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56321cac-1902-4961-a5a9-d9b45cebec69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:45.760748 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56321cac-1902-4961-a5a9-d9b45cebec69 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:45.761023 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56321cac-1902-4961-a5a9-d9b45cebec69 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:45.761293 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56321cac-1902-4961-a5a9-d9b45cebec69 None admin] PATH_INFO: `/v3/projects` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:45.761977 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56321cac-1902-4961-a5a9-d9b45cebec69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:45:45.762306 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56321cac-1902-4961-a5a9-d9b45cebec69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:45:45.763849 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56321cac-1902-4961-a5a9-d9b45cebec69 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:45:45.775651 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 461/936] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 23 00:45:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:45:45.782424 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf64f2-4f17-4eed-9a6f-578f904a8717 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:45.889036 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf64f2-4f17-4eed-9a6f-578f904a8717 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:45.926793 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edcb46-cf37-4b82-845b-063bf44306d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:45.927432 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edcb46-cf37-4b82-845b-063bf44306d9 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:45.927817 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edcb46-cf37-4b82-845b-063bf44306d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:45.928169 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edcb46-cf37-4b82-845b-063bf44306d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:45.929130 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73edcb46-cf37-4b82-845b-063bf44306d9 None admin] RBAC: Adding query filter params (role.id=832e4b25a75c4d30a010d6803a5a4577, scope.project.id=60f8594760e44ce3888a32702ea9afcc, user.id=1863d19ad4624ea496c2c73b70ae0c6e) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:45:45.929559 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73edcb46-cf37-4b82-845b-063bf44306d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:45:45.931311 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73edcb46-cf37-4b82-845b-063bf44306d9 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:45:45.939354 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 476/937] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 23 00:45:45 2022] GET /identity/v3/role_assignments?user.id=1863d19ad4624ea496c2c73b70ae0c6e&scope.project.id=60f8594760e44ce3888a32702ea9afcc&role.id=832e4b25a75c4d30a010d6803a5a4577 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:45:48.187330 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb3772-83e0-4999-a537-b14e3b9bfce3 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:48.187885 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb3772-83e0-4999-a537-b14e3b9bfce3 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:48.187885 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb3772-83e0-4999-a537-b14e3b9bfce3 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:48.189597 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 462/938] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:45:48.194675 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257e5bd-a505-48a7-a4a5-c1f9d2800172 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:48.196406 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257e5bd-a505-48a7-a4a5-c1f9d2800172 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:48.196406 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257e5bd-a505-48a7-a4a5-c1f9d2800172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:48.213752 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-3257e5bd-a505-48a7-a4a5-c1f9d2800172 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:45:48.215032 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-3257e5bd-a505-48a7-a4a5-c1f9d2800172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:45:48.218635 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:45:48.289553 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 477/939] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:45:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:45:48.554788 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb3772-83e0-4999-a537-b14e3b9bfce3 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:48.662599 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb3772-83e0-4999-a537-b14e3b9bfce3 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:48.691660 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:45:48.697582 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5083e-c00e-4f40-98e4-aafa244c74e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:48.698651 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5083e-c00e-4f40-98e4-aafa244c74e3 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:48.699334 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5083e-c00e-4f40-98e4-aafa244c74e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:48.699642 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5083e-c00e-4f40-98e4-aafa244c74e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:48.710629 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef5083e-c00e-4f40-98e4-aafa244c74e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:45:48.715420 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-6ef5083e-c00e-4f40-98e4-aafa244c74e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:45:48.715420 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:45:48.715420 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:45:48.715420 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:45:48.715420 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:45:48.715420 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:45:48.715420 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:45:48.715420 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:45:48.715420 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:45:48.715420 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:45:48.715420 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:45:48.715420 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:45:48.715420 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:45:48.715420 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:45:48.715420 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:45:48.715420 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:45:48.716407 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:45:48.716407 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:45:48.716407 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:45:48.716407 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:45:48.716407 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:45:48.716407 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:45:48.716407 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:45:48.716407 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:45:48.716407 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:45:48.716407 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:45:48.716407 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:45:48.716407 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:45:48.716407 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:45:48.716407 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:45:48.716407 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:45:48.716407 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:45:48.718307 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:45:48.718307 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:45:48.718307 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:45:48.718307 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:45:48.718307 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:45:48.718307 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:45:48.718307 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:45:48.718307 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:45:48.718307 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:45:48.718307 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:45:48.718307 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:45:48.718307 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:45:48.718307 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 463/940] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 23 00:45:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:45:48.723043 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3257e5bd-a505-48a7-a4a5-c1f9d2800172 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:48.826000 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3257e5bd-a505-48a7-a4a5-c1f9d2800172 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:48.867697 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b627ff4-3335-47c7-89aa-311c59fd9f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:48.868296 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b627ff4-3335-47c7-89aa-311c59fd9f28 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:48.868570 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b627ff4-3335-47c7-89aa-311c59fd9f28 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:48.868840 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b627ff4-3335-47c7-89aa-311c59fd9f28 None admin] PATH_INFO: `/v3/roles` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:48.869533 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b627ff4-3335-47c7-89aa-311c59fd9f28 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:45:48.869832 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b627ff4-3335-47c7-89aa-311c59fd9f28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:45:48.871326 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b627ff4-3335-47c7-89aa-311c59fd9f28 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:45:48.880697 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 478/941] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 23 00:45:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:45:48.886652 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5083e-c00e-4f40-98e4-aafa244c74e3 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:48.997163 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5083e-c00e-4f40-98e4-aafa244c74e3 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:49.033103 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4252c-d0fc-4037-8620-343dd380e4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:49.033784 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4252c-d0fc-4037-8620-343dd380e4ab None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:49.034295 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4252c-d0fc-4037-8620-343dd380e4ab None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:49.034597 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4252c-d0fc-4037-8620-343dd380e4ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:49.046207 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4252c-d0fc-4037-8620-343dd380e4ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:45:49.048090 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4252c-d0fc-4037-8620-343dd380e4ab None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:45:49.067180 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-f8d4252c-d0fc-4037-8620-343dd380e4ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:45:49.067180 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:45:49.067180 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:45:49.067180 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:45:49.067180 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:45:49.067180 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:45:49.067180 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:45:49.067180 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:45:49.067180 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:45:49.067180 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:45:49.067180 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:45:49.067180 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:45:49.067180 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:45:49.067180 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:45:49.067180 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:45:49.067180 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:45:49.068399 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:45:49.068399 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:45:49.068399 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:45:49.068399 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:45:49.068399 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:45:49.068399 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:45:49.068399 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:45:49.068399 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:45:49.068399 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:45:49.068399 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:45:49.068399 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:45:49.068399 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:45:49.068399 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:45:49.068399 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:45:49.068399 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:45:49.068399 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:45:49.068399 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:45:49.069710 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:45:49.069710 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:45:49.069710 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:45:49.069710 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 464/942] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:45:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 23 00:45:49.074387 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b627ff4-3335-47c7-89aa-311c59fd9f28 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:49.077923 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:45:49.189986 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b627ff4-3335-47c7-89aa-311c59fd9f28 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:49.224353 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ce12a-6b8a-4b0a-b52d-260168ea9d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:49.225093 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ce12a-6b8a-4b0a-b52d-260168ea9d79 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:49.225286 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ce12a-6b8a-4b0a-b52d-260168ea9d79 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:49.225561 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ce12a-6b8a-4b0a-b52d-260168ea9d79 None admin] PATH_INFO: `/v3/domains` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:49.226588 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ce12a-6b8a-4b0a-b52d-260168ea9d79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:45:49.226588 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ce12a-6b8a-4b0a-b52d-260168ea9d79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:45:49.227964 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ce12a-6b8a-4b0a-b52d-260168ea9d79 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:45:49.241772 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 479/943] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:45:49.247573 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4252c-d0fc-4037-8620-343dd380e4ab None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:49.292252 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:45:49.354817 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4252c-d0fc-4037-8620-343dd380e4ab None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:49.389769 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8954ee-b714-4c7b-8c23-92ee5e8a133b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:49.390432 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8954ee-b714-4c7b-8c23-92ee5e8a133b None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:49.390713 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8954ee-b714-4c7b-8c23-92ee5e8a133b None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:49.390985 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8954ee-b714-4c7b-8c23-92ee5e8a133b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:49.398622 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8954ee-b714-4c7b-8c23-92ee5e8a133b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:45:49.400140 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8954ee-b714-4c7b-8c23-92ee5e8a133b None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:45:49.411338 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-cb8954ee-b714-4c7b-8c23-92ee5e8a133b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 23 00:45:49.411338 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:45:49.411338 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:45:49.411338 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:45:49.411338 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:45:49.411338 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:45:49.411338 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:45:49.411338 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:45:49.411338 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:45:49.411338 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:45:49.411338 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:45:49.411338 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:45:49.411338 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 00:45:49.411338 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 00:45:49.411338 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 00:45:49.411338 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 00:45:49.412412 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:45:49.412412 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:45:49.412412 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:45:49.412412 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:45:49.412412 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:45:49.412412 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:45:49.412412 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:45:49.412412 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:45:49.412412 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:45:49.412412 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:45:49.412412 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:45:49.412412 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:45:49.412412 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:45:49.412412 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:45:49.412412 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:45:49.412412 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:45:49.412412 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:45:49.412412 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:45:49.413745 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:45:49.413745 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:45:49.413745 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 00:45:49.413745 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 00:45:49.413745 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 00:45:49.413745 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 00:45:49.413745 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 00:45:49.413745 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 00:45:49.413745 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 23 00:45:49.413745 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:45:49.413745 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 465/944] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:45:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:45:49.419366 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ce12a-6b8a-4b0a-b52d-260168ea9d79 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:49.485112 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:45:49.525309 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ce12a-6b8a-4b0a-b52d-260168ea9d79 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:49.563352 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88be1be-5730-4f68-8ff2-61b5f17b2340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:49.563960 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88be1be-5730-4f68-8ff2-61b5f17b2340 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:49.564236 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88be1be-5730-4f68-8ff2-61b5f17b2340 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:49.564506 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88be1be-5730-4f68-8ff2-61b5f17b2340 None admin] PATH_INFO: `/v3/users` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:49.565223 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88be1be-5730-4f68-8ff2-61b5f17b2340 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:45:49.565532 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88be1be-5730-4f68-8ff2-61b5f17b2340 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:45:49.566995 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88be1be-5730-4f68-8ff2-61b5f17b2340 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:45:49.590604 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 480/945] 10.222.0.23 () {56 vars in 1143 bytes} [Sun Oct 23 00:45:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:45:49.597062 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8954ee-b714-4c7b-8c23-92ee5e8a133b None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:49.708270 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8954ee-b714-4c7b-8c23-92ee5e8a133b None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:49.710223 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:45:49.750091 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cdc43b-337c-4b0f-a6ab-bbdd0b16f9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:49.751010 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdc43b-337c-4b0f-a6ab-bbdd0b16f9c8 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:49.751371 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdc43b-337c-4b0f-a6ab-bbdd0b16f9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:49.751699 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdc43b-337c-4b0f-a6ab-bbdd0b16f9c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:49.766743 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cdc43b-337c-4b0f-a6ab-bbdd0b16f9c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:45:49.768224 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cdc43b-337c-4b0f-a6ab-bbdd0b16f9c8 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:45:49.783678 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-64cdc43b-337c-4b0f-a6ab-bbdd0b16f9c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:45:49.783678 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:45:49.783678 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:45:49.783678 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:45:49.783678 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:45:49.783678 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:45:49.783678 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:45:49.783678 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:45:49.783678 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:45:49.783678 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:45:49.783678 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:45:49.783678 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:45:49.783678 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:45:49.783678 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:45:49.783678 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:45:49.783678 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:45:49.784670 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:45:49.784670 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:45:49.784670 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:45:49.784670 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:45:49.784670 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:45:49.784670 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:45:49.784670 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:45:49.784670 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:45:49.784670 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:45:49.784670 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:45:49.784670 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:45:49.784670 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:45:49.784670 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:45:49.784670 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:45:49.784670 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:45:49.784670 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:45:49.784670 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:45:49.785535 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:45:49.785535 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:45:49.785535 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:45:49.785535 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 466/946] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:45:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:45:49.790673 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88be1be-5730-4f68-8ff2-61b5f17b2340 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:49.904247 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88be1be-5730-4f68-8ff2-61b5f17b2340 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:49.926873 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:45:49.944490 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e2240a-45d3-446d-ac62-e6b42ca5004f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:49.945142 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2240a-45d3-446d-ac62-e6b42ca5004f None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:49.945464 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2240a-45d3-446d-ac62-e6b42ca5004f None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:49.945743 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2240a-45d3-446d-ac62-e6b42ca5004f None admin] PATH_INFO: `/v3/domains` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:49.946516 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e2240a-45d3-446d-ac62-e6b42ca5004f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:45:49.946854 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e2240a-45d3-446d-ac62-e6b42ca5004f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:45:49.948433 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e2240a-45d3-446d-ac62-e6b42ca5004f None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:45:49.961146 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 481/947] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:45:49.967619 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cdc43b-337c-4b0f-a6ab-bbdd0b16f9c8 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:50.085275 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cdc43b-337c-4b0f-a6ab-bbdd0b16f9c8 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:50.125043 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb4726-2371-4411-8a70-f53cef91af1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:50.125738 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb4726-2371-4411-8a70-f53cef91af1d None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:50.126025 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb4726-2371-4411-8a70-f53cef91af1d None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:50.126356 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb4726-2371-4411-8a70-f53cef91af1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:50.133446 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb4726-2371-4411-8a70-f53cef91af1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:45:50.135183 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb4726-2371-4411-8a70-f53cef91af1d None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:45:50.146858 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-b2fb4726-2371-4411-8a70-f53cef91af1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:45:50.146858 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:45:50.146858 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:45:50.146858 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:45:50.146858 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:45:50.146858 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:45:50.146858 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:45:50.146858 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:45:50.146858 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:45:50.146858 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:45:50.146858 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:45:50.146858 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:45:50.146858 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 00:45:50.146858 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 00:45:50.146858 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 00:45:50.153034 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 00:45:50.153034 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:45:50.153034 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:45:50.153034 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:45:50.153034 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:45:50.153034 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:45:50.153034 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:45:50.153034 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:45:50.153034 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:45:50.153034 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:45:50.153034 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:45:50.153034 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:45:50.153034 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:45:50.153034 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:45:50.153034 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:45:50.153034 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:45:50.153034 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:45:50.154163 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 00:45:50.154163 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 00:45:50.154163 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 00:45:50.154163 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 00:45:50.154163 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 00:45:50.154163 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 00:45:50.154163 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:45:50.154163 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:45:50.154163 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 467/948] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 23 00:45:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:45:50.154716 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e2240a-45d3-446d-ac62-e6b42ca5004f None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:50.266294 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e2240a-45d3-446d-ac62-e6b42ca5004f None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:50.303758 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed75cd8-ec59-4396-ada2-324b61dd8d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:50.304435 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed75cd8-ec59-4396-ada2-324b61dd8d63 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:50.304682 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed75cd8-ec59-4396-ada2-324b61dd8d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:50.304983 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed75cd8-ec59-4396-ada2-324b61dd8d63 None admin] PATH_INFO: `/v3/projects` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:50.305746 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed75cd8-ec59-4396-ada2-324b61dd8d63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:45:50.306051 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed75cd8-ec59-4396-ada2-324b61dd8d63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:45:50.307667 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed75cd8-ec59-4396-ada2-324b61dd8d63 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:45:50.325112 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 482/949] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 23 00:45:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:45:50.326331 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb4726-2371-4411-8a70-f53cef91af1d None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:50.344032 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:45:50.437264 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb4726-2371-4411-8a70-f53cef91af1d None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:50.472922 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec4662-532b-4de1-899d-a09eb725e70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:50.473679 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec4662-532b-4de1-899d-a09eb725e70d None admin] REQUEST_METHOD: `PUT` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:50.473991 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec4662-532b-4de1-899d-a09eb725e70d None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:50.474295 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec4662-532b-4de1-899d-a09eb725e70d None admin] PATH_INFO: `/v3/projects/60f8594760e44ce3888a32702ea9afcc/users/1863d19ad4624ea496c2c73b70ae0c6e/roles/1e2073be75174689aa4fac29e674583d` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:50.476169 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec4662-532b-4de1-899d-a09eb725e70d None admin] RBAC: Authorizing `identity:create_grant(project_id=60f8594760e44ce3888a32702ea9afcc, user_id=1863d19ad4624ea496c2c73b70ae0c6e, role_id=1e2073be75174689aa4fac29e674583d)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:45:50.477658 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec4662-532b-4de1-899d-a09eb725e70d None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:45:50.492976 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 468/950] 10.222.0.23 () {58 vars in 1439 bytes} [Sun Oct 23 00:45:50 2022] PUT /identity/v3/projects/60f8594760e44ce3888a32702ea9afcc/users/1863d19ad4624ea496c2c73b70ae0c6e/roles/1e2073be75174689aa4fac29e674583d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:45:52.774440 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7665a-4d91-416e-9310-8f56df388e2a None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:52.774970 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7665a-4d91-416e-9310-8f56df388e2a None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:52.774970 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7665a-4d91-416e-9310-8f56df388e2a None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:52.776342 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 483/951] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:45:52.782274 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59cce3-cf79-4ab7-b769-d3fd30f2df63 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:52.782780 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59cce3-cf79-4ab7-b769-d3fd30f2df63 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:52.782869 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59cce3-cf79-4ab7-b769-d3fd30f2df63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:52.803161 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-0f59cce3-cf79-4ab7-b769-d3fd30f2df63 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:45:52.804358 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-0f59cce3-cf79-4ab7-b769-d3fd30f2df63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:45:52.873704 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 469/952] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:45:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:45:53.190757 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7665a-4d91-416e-9310-8f56df388e2a None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:53.241228 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:45:53.308088 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7665a-4d91-416e-9310-8f56df388e2a None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:53.345977 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8090e-712d-4ea1-8559-925881b30c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:53.346646 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8090e-712d-4ea1-8559-925881b30c68 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:53.346926 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8090e-712d-4ea1-8559-925881b30c68 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:53.347271 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8090e-712d-4ea1-8559-925881b30c68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:53.357772 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8090e-712d-4ea1-8559-925881b30c68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 23 00:45:53.362633 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-b2f8090e-712d-4ea1-8559-925881b30c68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:45:53.362633 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:45:53.362633 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:45:53.362633 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:45:53.362633 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:45:53.362633 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:45:53.362633 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:45:53.362633 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:45:53.362633 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:45:53.362633 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:45:53.362633 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:45:53.362633 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:45:53.362633 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 23 00:45:53.362633 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 23 00:45:53.362633 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 23 00:45:53.362633 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 23 00:45:53.363914 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 23 00:45:53.363914 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 23 00:45:53.363914 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 23 00:45:53.363914 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 23 00:45:53.363914 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:45:53.363914 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:45:53.363914 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:45:53.363914 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:45:53.363914 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:45:53.363914 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:45:53.363914 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:45:53.363914 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:45:53.363914 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:45:53.363914 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:45:53.363914 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:45:53.363914 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:45:53.364871 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:45:53.364871 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:45:53.364871 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:45:53.364871 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:45:53.364871 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 23 00:45:53.364871 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 23 00:45:53.364871 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 23 00:45:53.364871 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 23 00:45:53.364871 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 23 00:45:53.364871 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 23 00:45:53.364871 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 23 00:45:53.364871 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:45:53.364871 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 484/953] 10.222.0.23 () {56 vars in 1096 bytes} [Sun Oct 23 00:45:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:45:53.369860 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f59cce3-cf79-4ab7-b769-d3fd30f2df63 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:53.373507 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:45:53.475087 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f59cce3-cf79-4ab7-b769-d3fd30f2df63 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:53.513217 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0f373-84cf-407e-a985-d0c8afc1c1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:53.514489 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0f373-84cf-407e-a985-d0c8afc1c1c2 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:53.514773 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0f373-84cf-407e-a985-d0c8afc1c1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:53.515078 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0f373-84cf-407e-a985-d0c8afc1c1c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:53.515966 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d0f373-84cf-407e-a985-d0c8afc1c1c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:45:53.516475 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d0f373-84cf-407e-a985-d0c8afc1c1c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:45:53.517940 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d0f373-84cf-407e-a985-d0c8afc1c1c2 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:45:53.532683 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 470/954] 10.222.0.23 () {56 vars in 1099 bytes} [Sun Oct 23 00:45:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:45:53.534213 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8090e-712d-4ea1-8559-925881b30c68 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:53.638587 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:45:53.641885 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8090e-712d-4ea1-8559-925881b30c68 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:53.677942 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f327c-1b67-4b46-8f1d-04384e1fb2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:53.678736 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f327c-1b67-4b46-8f1d-04384e1fb2ba None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:53.679017 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f327c-1b67-4b46-8f1d-04384e1fb2ba None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:53.679291 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f327c-1b67-4b46-8f1d-04384e1fb2ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:53.693916 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54f327c-1b67-4b46-8f1d-04384e1fb2ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:45:53.695548 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54f327c-1b67-4b46-8f1d-04384e1fb2ba None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:45:53.710892 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-b54f327c-1b67-4b46-8f1d-04384e1fb2ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:45:53.710892 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:45:53.710892 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:45:53.710892 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:45:53.710892 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:45:53.710892 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:45:53.710892 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:45:53.710892 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:45:53.710892 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:45:53.710892 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:45:53.710892 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:45:53.710892 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:45:53.710892 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:45:53.710892 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:45:53.710892 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:45:53.710892 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:45:53.712030 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:45:53.712030 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:45:53.712030 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:45:53.712030 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:45:53.712030 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:45:53.712030 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:45:53.712030 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:45:53.712030 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:45:53.712030 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:45:53.712030 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:45:53.712030 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:45:53.712030 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:45:53.712030 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:45:53.712030 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:45:53.712030 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:45:53.712030 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:45:53.712030 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:45:53.713433 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:45:53.713433 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:45:53.713433 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:45:53.713433 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 485/955] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:45:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:45:53.717556 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0f373-84cf-407e-a985-d0c8afc1c1c2 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:53.791936 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:45:53.831221 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0f373-84cf-407e-a985-d0c8afc1c1c2 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:53.865926 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ef658-1653-40be-a131-cf52852ec073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:53.866582 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ef658-1653-40be-a131-cf52852ec073 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:53.866865 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ef658-1653-40be-a131-cf52852ec073 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:53.867139 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ef658-1653-40be-a131-cf52852ec073 None admin] PATH_INFO: `/v3/domains` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:53.867798 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ef658-1653-40be-a131-cf52852ec073 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:45:53.868102 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ef658-1653-40be-a131-cf52852ec073 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:45:53.869512 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ef658-1653-40be-a131-cf52852ec073 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:45:53.883237 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 471/956] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:45:53.889248 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f327c-1b67-4b46-8f1d-04384e1fb2ba None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:54.010130 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f327c-1b67-4b46-8f1d-04384e1fb2ba None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:54.046882 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39d199-1579-49c8-8d73-d71f30b16be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:54.047436 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39d199-1579-49c8-8d73-d71f30b16be5 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:54.047718 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39d199-1579-49c8-8d73-d71f30b16be5 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:54.047989 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39d199-1579-49c8-8d73-d71f30b16be5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:54.056238 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b39d199-1579-49c8-8d73-d71f30b16be5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:45:54.057715 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b39d199-1579-49c8-8d73-d71f30b16be5 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:45:54.069925 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-2b39d199-1579-49c8-8d73-d71f30b16be5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 23 00:45:54.069925 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:45:54.069925 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:45:54.069925 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:45:54.069925 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:45:54.069925 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:45:54.069925 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:45:54.069925 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:45:54.069925 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:45:54.069925 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:45:54.069925 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:45:54.069925 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:45:54.069925 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 23 00:45:54.069925 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 23 00:45:54.069925 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 23 00:45:54.069925 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 23 00:45:54.071119 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:45:54.071119 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:45:54.071119 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 23 00:45:54.071119 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:45:54.071119 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 23 00:45:54.071119 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 23 00:45:54.071119 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:45:54.071119 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:45:54.071119 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:45:54.071119 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:45:54.071119 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:45:54.071119 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:45:54.071119 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:45:54.071119 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:45:54.071119 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:45:54.071119 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:45:54.071119 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:45:54.071119 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:45:54.072054 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:45:54.072054 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:45:54.072054 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 23 00:45:54.072054 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 23 00:45:54.072054 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 23 00:45:54.072054 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 23 00:45:54.072054 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 23 00:45:54.072054 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 23 00:45:54.072054 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 23 00:45:54.072054 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:45:54.072054 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 486/957] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:45:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:45:54.077196 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ef658-1653-40be-a131-cf52852ec073 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:54.182039 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ef658-1653-40be-a131-cf52852ec073 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:54.207126 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:45:54.216232 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818ec8a-7275-4e52-bac1-6a2a1ef8dbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:54.217376 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818ec8a-7275-4e52-bac1-6a2a1ef8dbb0 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:54.217656 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818ec8a-7275-4e52-bac1-6a2a1ef8dbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:54.217929 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818ec8a-7275-4e52-bac1-6a2a1ef8dbb0 None admin] PATH_INFO: `/v3/users` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:54.218690 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d818ec8a-7275-4e52-bac1-6a2a1ef8dbb0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:45:54.218998 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d818ec8a-7275-4e52-bac1-6a2a1ef8dbb0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:45:54.220427 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d818ec8a-7275-4e52-bac1-6a2a1ef8dbb0 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:45:54.243117 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 472/958] 10.222.0.23 () {56 vars in 1143 bytes} [Sun Oct 23 00:45:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:45:54.249180 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39d199-1579-49c8-8d73-d71f30b16be5 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:54.265187 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:45:54.353107 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39d199-1579-49c8-8d73-d71f30b16be5 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:54.387025 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74eba2a-be69-4426-b79f-6dbe40def17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:54.387635 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74eba2a-be69-4426-b79f-6dbe40def17f None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:54.387924 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74eba2a-be69-4426-b79f-6dbe40def17f None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:54.388198 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74eba2a-be69-4426-b79f-6dbe40def17f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:54.455518 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74eba2a-be69-4426-b79f-6dbe40def17f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:45:54.456970 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74eba2a-be69-4426-b79f-6dbe40def17f None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:45:54.470538 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:45:54.551944 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 487/959] 10.222.0.23 () {58 vars in 1282 bytes} [Sun Oct 23 00:45:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 23 00:45:54.557692 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818ec8a-7275-4e52-bac1-6a2a1ef8dbb0 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:54.652911 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818ec8a-7275-4e52-bac1-6a2a1ef8dbb0 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:54.685430 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc55b93-262b-4ed8-b9df-04fe6fb6d33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:54.686036 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc55b93-262b-4ed8-b9df-04fe6fb6d33b None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:54.686366 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc55b93-262b-4ed8-b9df-04fe6fb6d33b None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:54.686637 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc55b93-262b-4ed8-b9df-04fe6fb6d33b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:54.696297 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc55b93-262b-4ed8-b9df-04fe6fb6d33b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:45:54.697713 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc55b93-262b-4ed8-b9df-04fe6fb6d33b None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:45:54.711994 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-0fc55b93-262b-4ed8-b9df-04fe6fb6d33b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:45:54.711994 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:45:54.711994 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:45:54.711994 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:45:54.711994 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:45:54.711994 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:45:54.711994 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:45:54.711994 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:45:54.711994 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:45:54.711994 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:45:54.711994 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:45:54.711994 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:45:54.711994 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 23 00:45:54.711994 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 23 00:45:54.711994 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 23 00:45:54.711994 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 23 00:45:54.713094 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:45:54.713094 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:45:54.713094 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:45:54.713094 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:45:54.713094 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:45:54.713094 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:45:54.713094 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:45:54.713094 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:45:54.713094 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:45:54.713094 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:45:54.713094 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:45:54.713094 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:45:54.713094 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:45:54.713094 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:45:54.713094 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:45:54.713094 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:45:54.713094 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 23 00:45:54.714234 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 23 00:45:54.714234 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 23 00:45:54.714234 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:45:54.714234 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 473/960] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:45:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:45:54.719139 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74eba2a-be69-4426-b79f-6dbe40def17f None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:54.813296 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74eba2a-be69-4426-b79f-6dbe40def17f None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:54.827109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:45:54.847449 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf3ea86-efcf-4e2e-bead-afc3b30eb27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:54.848029 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3ea86-efcf-4e2e-bead-afc3b30eb27a None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:54.848304 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3ea86-efcf-4e2e-bead-afc3b30eb27a None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:54.848571 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3ea86-efcf-4e2e-bead-afc3b30eb27a None admin] PATH_INFO: `/v3/domains` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:54.849197 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf3ea86-efcf-4e2e-bead-afc3b30eb27a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:45:54.849491 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf3ea86-efcf-4e2e-bead-afc3b30eb27a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:45:54.850869 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf3ea86-efcf-4e2e-bead-afc3b30eb27a None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:45:54.862010 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 488/961] 10.222.0.23 () {56 vars in 1109 bytes} [Sun Oct 23 00:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:45:54.867437 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc55b93-262b-4ed8-b9df-04fe6fb6d33b None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:54.901756 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:45:54.969568 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc55b93-262b-4ed8-b9df-04fe6fb6d33b None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:55.001662 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16706e64-8689-4d2d-921a-1fdf42f3be83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:55.002307 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16706e64-8689-4d2d-921a-1fdf42f3be83 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:55.002589 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16706e64-8689-4d2d-921a-1fdf42f3be83 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:55.002888 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16706e64-8689-4d2d-921a-1fdf42f3be83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:55.009191 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16706e64-8689-4d2d-921a-1fdf42f3be83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:45:55.010666 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16706e64-8689-4d2d-921a-1fdf42f3be83 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:45:55.022008 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application [None req-16706e64-8689-4d2d-921a-1fdf42f3be83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:45:55.022008 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:45:55.022008 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:45:55.022008 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:45:55.022008 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:45:55.022008 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:45:55.022008 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:45:55.022008 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:45:55.022008 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:45:55.022008 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:45:55.022008 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:45:55.022008 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:45:55.022008 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 23 00:45:55.022008 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 23 00:45:55.022008 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 23 00:45:55.023069 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 23 00:45:55.023069 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:45:55.023069 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:45:55.023069 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:45:55.023069 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:45:55.023069 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:45:55.023069 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:45:55.023069 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:45:55.023069 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application with Lock( Oct 23 00:45:55.023069 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:45:55.023069 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:45:55.023069 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:45:55.023069 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:45:55.023069 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:45:55.023069 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:45:55.023069 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:45:55.023069 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:45:55.024162 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 23 00:45:55.024162 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 23 00:45:55.024162 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 23 00:45:55.024162 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 23 00:45:55.024162 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 23 00:45:55.024162 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 23 00:45:55.024162 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 23 00:45:55.024162 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: ERROR keystone.server.flask.application Oct 23 00:45:55.024162 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 474/962] 10.222.0.23 () {56 vars in 1111 bytes} [Sun Oct 23 00:45:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:45:55.028863 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf3ea86-efcf-4e2e-bead-afc3b30eb27a None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:55.125801 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf3ea86-efcf-4e2e-bead-afc3b30eb27a None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:55.157465 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fec7f7-adef-4197-b0ab-84ff2f70c1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:55.158050 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fec7f7-adef-4197-b0ab-84ff2f70c1e3 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:55.158359 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fec7f7-adef-4197-b0ab-84ff2f70c1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:55.158629 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fec7f7-adef-4197-b0ab-84ff2f70c1e3 None admin] PATH_INFO: `/v3/projects` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:55.159307 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fec7f7-adef-4197-b0ab-84ff2f70c1e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:45:55.159607 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fec7f7-adef-4197-b0ab-84ff2f70c1e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:45:55.161018 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fec7f7-adef-4197-b0ab-84ff2f70c1e3 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:45:55.172870 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 489/963] 10.222.0.23 () {56 vars in 1148 bytes} [Sun Oct 23 00:45:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:45:55.178752 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16706e64-8689-4d2d-921a-1fdf42f3be83 None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:55.270656 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:45:55.276644 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16706e64-8689-4d2d-921a-1fdf42f3be83 None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:55.308837 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447ce71-c8ee-4b1d-8a46-923098344f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:55.309424 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447ce71-c8ee-4b1d-8a46-923098344f0c None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:55.309703 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447ce71-c8ee-4b1d-8a46-923098344f0c None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:55.309976 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447ce71-c8ee-4b1d-8a46-923098344f0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:55.310728 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447ce71-c8ee-4b1d-8a46-923098344f0c None admin] RBAC: Adding query filter params (role.id=1e2073be75174689aa4fac29e674583d, scope.project.id=60f8594760e44ce3888a32702ea9afcc, user.id=1863d19ad4624ea496c2c73b70ae0c6e) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:45:55.311037 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447ce71-c8ee-4b1d-8a46-923098344f0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:45:55.312465 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447ce71-c8ee-4b1d-8a46-923098344f0c None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:45:55.318016 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 475/964] 10.222.0.23 () {56 vars in 1374 bytes} [Sun Oct 23 00:45:55 2022] GET /identity/v3/role_assignments?user.id=1863d19ad4624ea496c2c73b70ae0c6e&scope.project.id=60f8594760e44ce3888a32702ea9afcc&role.id=1e2073be75174689aa4fac29e674583d => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:45:57.468690 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48598e0-5e6c-4f8f-9f28-58635d536c80 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:57.469211 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48598e0-5e6c-4f8f-9f28-58635d536c80 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:57.469211 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48598e0-5e6c-4f8f-9f28-58635d536c80 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:57.470610 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 490/965] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:45:57.475726 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae518d8-9197-4df7-913f-4f49dd96aa9d None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:57.476171 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae518d8-9197-4df7-913f-4f49dd96aa9d None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:57.476311 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae518d8-9197-4df7-913f-4f49dd96aa9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:57.494692 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-7ae518d8-9197-4df7-913f-4f49dd96aa9d None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:45:57.495868 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-7ae518d8-9197-4df7-913f-4f49dd96aa9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:45:57.558947 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 476/966] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:45:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:45:57.827110 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48598e0-5e6c-4f8f-9f28-58635d536c80 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:57.858393 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:45:57.927203 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48598e0-5e6c-4f8f-9f28-58635d536c80 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:57.967088 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9111177-5fad-464c-8760-dc4c06989025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:57.967725 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9111177-5fad-464c-8760-dc4c06989025 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:57.968001 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9111177-5fad-464c-8760-dc4c06989025 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:57.968305 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9111177-5fad-464c-8760-dc4c06989025 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:57.968854 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9111177-5fad-464c-8760-dc4c06989025 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:45:57.970273 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9111177-5fad-464c-8760-dc4c06989025 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:45:57.979567 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-e9111177-5fad-464c-8760-dc4c06989025 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 23 00:45:57.979567 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:45:57.979567 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:45:57.979567 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:45:57.979567 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:45:57.979567 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:45:57.979567 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:45:57.979567 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:45:57.979567 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 23 00:45:57.979567 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:45:57.979567 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:45:57.979567 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:45:57.979567 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:45:57.979567 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:45:57.979567 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:45:57.979567 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:45:57.979567 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:45:57.980640 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:45:57.980640 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:45:57.980640 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:45:57.980640 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:45:57.980640 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:45:57.980640 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:45:57.980640 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:45:57.980640 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:45:57.980640 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:45:57.980640 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:45:57.980640 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:45:57.980640 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:45:57.980640 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:45:57.980640 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:45:57.980640 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:45:57.980640 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:45:57.981919 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:45:57.981919 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:45:57.981919 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:45:57.981919 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:45:57.981919 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:45:57.981919 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:45:57.981919 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:45:57.981919 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:45:57.981919 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:45:57.981919 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:45:57.981919 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:45:57.981919 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:45:57.981919 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 23 00:45:57.981919 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:45:57.981919 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 491/967] 10.222.0.23 () {56 vars in 1117 bytes} [Sun Oct 23 00:45:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:45:57.987539 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae518d8-9197-4df7-913f-4f49dd96aa9d None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:58.076823 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:45:58.086491 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae518d8-9197-4df7-913f-4f49dd96aa9d None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:58.121629 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb020c3-6fb9-4e7f-a045-dee69bdf788a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:58.122251 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb020c3-6fb9-4e7f-a045-dee69bdf788a None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:58.122528 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb020c3-6fb9-4e7f-a045-dee69bdf788a None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:58.122837 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb020c3-6fb9-4e7f-a045-dee69bdf788a None admin] PATH_INFO: `/v3/services` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:58.123456 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb020c3-6fb9-4e7f-a045-dee69bdf788a None admin] RBAC: Adding query filter params (name=placement) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:45:58.123752 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb020c3-6fb9-4e7f-a045-dee69bdf788a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:45:58.125249 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb020c3-6fb9-4e7f-a045-dee69bdf788a None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:45:58.129921 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 477/968] 10.222.0.23 () {56 vars in 1116 bytes} [Sun Oct 23 00:45:57 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:45:58.135728 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9111177-5fad-464c-8760-dc4c06989025 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:45:58.227659 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:45:58.234434 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9111177-5fad-464c-8760-dc4c06989025 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:45:58.267040 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c787e4-f867-4294-b615-4107c1fc4bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:45:58.267632 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c787e4-f867-4294-b615-4107c1fc4bb5 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:45:58.267908 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c787e4-f867-4294-b615-4107c1fc4bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:45:58.268176 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c787e4-f867-4294-b615-4107c1fc4bb5 None admin] PATH_INFO: `/v3/services` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:45:58.268794 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c787e4-f867-4294-b615-4107c1fc4bb5 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:45:58.269091 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c787e4-f867-4294-b615-4107c1fc4bb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:45:58.270478 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c787e4-f867-4294-b615-4107c1fc4bb5 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:45:58.274753 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 492/969] 10.222.0.23 () {56 vars in 1116 bytes} [Sun Oct 23 00:45:58 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:46:00.377598 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6630c3f-03e7-4620-b9a5-570c501384ed None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:46:00.378246 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6630c3f-03e7-4620-b9a5-570c501384ed None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:46:00.378246 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6630c3f-03e7-4620-b9a5-570c501384ed None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:46:00.379474 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 478/970] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:46:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:46:00.384567 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13305749-fcf9-48a5-93fa-0482adc16936 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:46:00.384980 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13305749-fcf9-48a5-93fa-0482adc16936 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:46:00.385122 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13305749-fcf9-48a5-93fa-0482adc16936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:46:00.403388 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-13305749-fcf9-48a5-93fa-0482adc16936 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:46:00.405170 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-13305749-fcf9-48a5-93fa-0482adc16936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:46:00.469386 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 493/971] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:46:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:46:00.734311 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6630c3f-03e7-4620-b9a5-570c501384ed None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:46:00.829472 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6630c3f-03e7-4620-b9a5-570c501384ed None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:46:00.862024 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6560e19-73d7-4afc-a309-18088c8c26ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:46:00.862628 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6560e19-73d7-4afc-a309-18088c8c26ab None admin] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:46:00.862906 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6560e19-73d7-4afc-a309-18088c8c26ab None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:46:00.863178 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6560e19-73d7-4afc-a309-18088c8c26ab None admin] PATH_INFO: `/v3/services` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:46:00.863822 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6560e19-73d7-4afc-a309-18088c8c26ab None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:46:00.865174 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6560e19-73d7-4afc-a309-18088c8c26ab None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:46:00.878876 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 479/972] 10.222.0.23 () {60 vars in 1141 bytes} [Sun Oct 23 00:46:00 2022] POST /identity/v3/services => generated 246 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:46:03.029337 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e1e06-ad8e-4d5f-b59b-4e86d7c10f76 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:46:03.029923 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e1e06-ad8e-4d5f-b59b-4e86d7c10f76 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:46:03.029923 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e1e06-ad8e-4d5f-b59b-4e86d7c10f76 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:46:03.031258 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 494/973] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:46:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:46:03.036338 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2477795-e74e-4086-9d34-2aada63ef648 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:46:03.036739 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2477795-e74e-4086-9d34-2aada63ef648 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:46:03.036887 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2477795-e74e-4086-9d34-2aada63ef648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:46:03.055303 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-c2477795-e74e-4086-9d34-2aada63ef648 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:46:03.056495 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-c2477795-e74e-4086-9d34-2aada63ef648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:46:03.065413 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:46:03.127730 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 480/974] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:46:03 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:46:03.396019 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e1e06-ad8e-4d5f-b59b-4e86d7c10f76 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:46:03.484549 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:46:03.495121 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e1e06-ad8e-4d5f-b59b-4e86d7c10f76 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:46:03.527735 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7325dda1-85b1-4cde-a28d-39069a3e3411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:46:03.528347 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325dda1-85b1-4cde-a28d-39069a3e3411 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:46:03.528627 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325dda1-85b1-4cde-a28d-39069a3e3411 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:46:03.529437 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325dda1-85b1-4cde-a28d-39069a3e3411 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:46:03.530012 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7325dda1-85b1-4cde-a28d-39069a3e3411 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:46:03.531406 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7325dda1-85b1-4cde-a28d-39069a3e3411 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:46:03.539959 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-7325dda1-85b1-4cde-a28d-39069a3e3411 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 23 00:46:03.539959 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:46:03.539959 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:46:03.539959 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:46:03.539959 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:46:03.539959 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:46:03.539959 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:46:03.539959 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:46:03.539959 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 23 00:46:03.539959 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:46:03.539959 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:46:03.539959 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:46:03.539959 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:46:03.539959 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:46:03.539959 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:46:03.539959 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:46:03.539959 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:46:03.541158 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:46:03.541158 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:46:03.541158 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:46:03.541158 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:46:03.541158 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:46:03.541158 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:46:03.541158 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:46:03.541158 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:46:03.541158 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:46:03.541158 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:46:03.541158 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:46:03.541158 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:46:03.541158 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:46:03.541158 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:46:03.541158 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:46:03.541158 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:46:03.542243 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:46:03.542243 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:46:03.542243 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:46:03.542243 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:46:03.542243 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:46:03.542243 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:46:03.542243 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:46:03.542243 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:46:03.542243 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:46:03.542243 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:46:03.542243 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:46:03.542243 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:46:03.542243 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 23 00:46:03.542243 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:46:03.542243 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 495/975] 10.222.0.23 () {56 vars in 1117 bytes} [Sun Oct 23 00:46:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:46:03.547138 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2477795-e74e-4086-9d34-2aada63ef648 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:46:03.643092 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2477795-e74e-4086-9d34-2aada63ef648 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:46:03.675861 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e3799-bbe5-43ed-810d-711277cf125f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:46:03.676396 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e3799-bbe5-43ed-810d-711277cf125f None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:46:03.676676 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e3799-bbe5-43ed-810d-711277cf125f None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:46:03.676948 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e3799-bbe5-43ed-810d-711277cf125f None admin] PATH_INFO: `/v3/services` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:46:03.677566 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e3799-bbe5-43ed-810d-711277cf125f None admin] RBAC: Adding query filter params (name=placement) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:46:03.677867 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e3799-bbe5-43ed-810d-711277cf125f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:46:03.679262 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e3799-bbe5-43ed-810d-711277cf125f None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:46:03.684240 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 481/976] 10.222.0.23 () {56 vars in 1116 bytes} [Sun Oct 23 00:46:03 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:46:03.690150 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7325dda1-85b1-4cde-a28d-39069a3e3411 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:46:03.787622 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7325dda1-85b1-4cde-a28d-39069a3e3411 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:46:03.819567 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff81463-31ea-4702-b5d7-0fa3bc4f4ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:46:03.820150 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff81463-31ea-4702-b5d7-0fa3bc4f4ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:46:03.820428 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff81463-31ea-4702-b5d7-0fa3bc4f4ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:46:03.820699 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff81463-31ea-4702-b5d7-0fa3bc4f4ea0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:46:03.821389 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff81463-31ea-4702-b5d7-0fa3bc4f4ea0 None admin] RBAC: Adding query filter params (interface=public, service_id=ecabb5cfee72426595a8b65a66abac55, region_id=RegionOne) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:46:03.821695 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff81463-31ea-4702-b5d7-0fa3bc4f4ea0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:46:03.823082 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff81463-31ea-4702-b5d7-0fa3bc4f4ea0 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:46:03.828444 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 496/977] 10.222.0.23 () {56 vars in 1251 bytes} [Sun Oct 23 00:46:03 2022] GET /identity/v3/endpoints?service_id=ecabb5cfee72426595a8b65a66abac55&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:46:03.834053 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e3799-bbe5-43ed-810d-711277cf125f None admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:46:03.837804 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:46:03.929684 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e3799-bbe5-43ed-810d-711277cf125f None admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:46:03.970907 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7d5e6-6f0d-4638-b099-4dcc0febc642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:46:03.971565 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7d5e6-6f0d-4638-b099-4dcc0febc642 None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:46:03.971856 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7d5e6-6f0d-4638-b099-4dcc0febc642 None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:46:03.972176 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7d5e6-6f0d-4638-b099-4dcc0febc642 None admin] PATH_INFO: `/v3/services` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:46:03.972823 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b7d5e6-6f0d-4638-b099-4dcc0febc642 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:46:03.974254 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b7d5e6-6f0d-4638-b099-4dcc0febc642 None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:46:03.981892 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 482/978] 10.222.0.23 () {56 vars in 1087 bytes} [Sun Oct 23 00:46:03 2022] GET /identity/v3/services => generated 2191 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:46:06.104217 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85684f-ec15-49e3-aa24-b59b249f0ec8 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:46:06.104774 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85684f-ec15-49e3-aa24-b59b249f0ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:46:06.104774 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85684f-ec15-49e3-aa24-b59b249f0ec8 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:46:06.106130 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 497/979] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:46:06.111473 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9e98d-7b62-4524-8dea-d833f80cd2e6 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:46:06.111881 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9e98d-7b62-4524-8dea-d833f80cd2e6 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:46:06.112012 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9e98d-7b62-4524-8dea-d833f80cd2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:46:06.130050 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-89a9e98d-7b62-4524-8dea-d833f80cd2e6 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:46:06.131254 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-89a9e98d-7b62-4524-8dea-d833f80cd2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:46:06.193585 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:46:06.198900 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 483/980] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:46:06 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 23 00:46:06.465907 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab85684f-ec15-49e3-aa24-b59b249f0ec8 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:46:06.485679 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:46:06.566116 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab85684f-ec15-49e3-aa24-b59b249f0ec8 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:46:06.597768 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0675abce-086c-4def-bfca-4af6ddd75931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:46:06.598409 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675abce-086c-4def-bfca-4af6ddd75931 None admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:46:06.598691 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675abce-086c-4def-bfca-4af6ddd75931 None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:46:06.598963 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675abce-086c-4def-bfca-4af6ddd75931 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:46:06.599538 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0675abce-086c-4def-bfca-4af6ddd75931 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:46:06.600895 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0675abce-086c-4def-bfca-4af6ddd75931 None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:46:06.610286 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application [None req-0675abce-086c-4def-bfca-4af6ddd75931 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 23 00:46:06.610286 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:46:06.610286 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 23 00:46:06.610286 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 23 00:46:06.610286 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 23 00:46:06.610286 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 23 00:46:06.610286 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 23 00:46:06.610286 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:46:06.610286 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 23 00:46:06.610286 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:46:06.610286 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 23 00:46:06.610286 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:46:06.610286 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 23 00:46:06.610286 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 23 00:46:06.610286 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 23 00:46:06.610286 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 23 00:46:06.610286 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 23 00:46:06.611482 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 23 00:46:06.611482 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 23 00:46:06.611482 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 23 00:46:06.611482 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 23 00:46:06.611482 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 23 00:46:06.611482 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 23 00:46:06.611482 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 23 00:46:06.611482 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 23 00:46:06.611482 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 23 00:46:06.611482 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 23 00:46:06.611482 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 23 00:46:06.611482 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 23 00:46:06.611482 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 23 00:46:06.611482 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 23 00:46:06.611482 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 23 00:46:06.611482 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.get_or_create( Oct 23 00:46:06.612361 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 23 00:46:06.612361 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application with Lock( Oct 23 00:46:06.612361 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 23 00:46:06.612361 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self._enter() Oct 23 00:46:06.612361 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 23 00:46:06.612361 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 23 00:46:06.612361 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 23 00:46:06.612361 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application return self.creator() Oct 23 00:46:06.612361 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 23 00:46:06.612361 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application created_value = creator( Oct 23 00:46:06.612361 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 23 00:46:06.612361 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 23 00:46:06.612361 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 23 00:46:06.612361 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: ERROR keystone.server.flask.application Oct 23 00:46:06.612361 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 498/981] 10.222.0.23 () {56 vars in 1117 bytes} [Sun Oct 23 00:46:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 23 00:46:06.617209 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9e98d-7b62-4524-8dea-d833f80cd2e6 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:46:06.711629 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9e98d-7b62-4524-8dea-d833f80cd2e6 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:46:06.744796 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64705fe2-2184-4545-99b9-ac4f39f503eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:46:06.745330 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64705fe2-2184-4545-99b9-ac4f39f503eb None admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:46:06.745609 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64705fe2-2184-4545-99b9-ac4f39f503eb None admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:46:06.745882 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64705fe2-2184-4545-99b9-ac4f39f503eb None admin] PATH_INFO: `/v3/services` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:46:06.746536 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64705fe2-2184-4545-99b9-ac4f39f503eb None admin] RBAC: Adding query filter params (name=placement) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:46:06.746838 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64705fe2-2184-4545-99b9-ac4f39f503eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:46:06.748233 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64705fe2-2184-4545-99b9-ac4f39f503eb None admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:46:06.753145 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 484/982] 10.222.0.23 () {56 vars in 1116 bytes} [Sun Oct 23 00:46:06 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:46:06.758810 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0675abce-086c-4def-bfca-4af6ddd75931 None admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:46:06.837534 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:46:06.856234 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0675abce-086c-4def-bfca-4af6ddd75931 None admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:46:06.888866 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6567cd-4a88-426d-a142-19ebf44bc26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:46:06.889449 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6567cd-4a88-426d-a142-19ebf44bc26a None admin] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:46:06.889730 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6567cd-4a88-426d-a142-19ebf44bc26a None admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:46:06.890002 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6567cd-4a88-426d-a142-19ebf44bc26a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:46:06.890689 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6567cd-4a88-426d-a142-19ebf44bc26a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:46:06.892047 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6567cd-4a88-426d-a142-19ebf44bc26a None admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:46:06.910731 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 499/983] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 23 00:46:06 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:46:16.750667 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=69 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:46:16.906585 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:47:09.834262 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79617c4f-b085-4d93-94b3-20321793b981 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:47:09.834881 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79617c4f-b085-4d93-94b3-20321793b981 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:47:09.834881 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79617c4f-b085-4d93-94b3-20321793b981 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:47:09.841420 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acbcbb-77b0-41fc-8a78-5cf128027395 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:47:09.841839 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acbcbb-77b0-41fc-8a78-5cf128027395 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:47:09.842102 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acbcbb-77b0-41fc-8a78-5cf128027395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:47:09.846783 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 485/984] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:47:09 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:47:09.919152 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-26acbcbb-77b0-41fc-8a78-5cf128027395 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:47:09.920667 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-26acbcbb-77b0-41fc-8a78-5cf128027395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:47:10.082103 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 500/985] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:47:10.366390 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde7da7-4310-419d-8ec0-e654209544e2 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:47:10.366673 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde7da7-4310-419d-8ec0-e654209544e2 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:47:10.366945 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde7da7-4310-419d-8ec0-e654209544e2 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:47:10.368299 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 486/986] 10.222.0.23 () {54 vars in 964 bytes} [Sun Oct 23 00:47:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:47:10.375165 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087253ce-b3ac-4010-9731-581764770cad None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:47:10.375458 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087253ce-b3ac-4010-9731-581764770cad None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:47:10.375739 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087253ce-b3ac-4010-9731-581764770cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:47:10.457652 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-087253ce-b3ac-4010-9731-581764770cad None None] MFA Rules not processed for user `04804cfc28b84d398ef06e8e113a755d`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:47:10.458923 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-087253ce-b3ac-4010-9731-581764770cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:47:10.482486 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:47:10.546243 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 501/987] 10.222.0.23 () {58 vars in 1061 bytes} [Sun Oct 23 00:47:10 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:47:10.555779 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde7da7-4310-419d-8ec0-e654209544e2 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:47:10.558332 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-fcde7da7-4310-419d-8ec0-e654209544e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:47:10.684302 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde7da7-4310-419d-8ec0-e654209544e2 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:47:10.773579 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2cf37-06eb-4321-a35f-489ce8c2dafa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04804cfc28b84d398ef06e8e113a755d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:47:10.774332 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2cf37-06eb-4321-a35f-489ce8c2dafa service neutron] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:47:10.774682 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2cf37-06eb-4321-a35f-489ce8c2dafa service neutron] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:47:10.775029 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2cf37-06eb-4321-a35f-489ce8c2dafa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:47:10.777228 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-afa2cf37-06eb-4321-a35f-489ce8c2dafa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:47:10.834594 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:47:10.892042 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa2cf37-06eb-4321-a35f-489ce8c2dafa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:47:10.893474 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa2cf37-06eb-4321-a35f-489ce8c2dafa service neutron] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:47:10.912890 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 487/988] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:47:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:47:13.347721 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20350e8d-263e-4b2e-97ea-fd6be3562843 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:47:13.348278 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20350e8d-263e-4b2e-97ea-fd6be3562843 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:47:13.348278 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20350e8d-263e-4b2e-97ea-fd6be3562843 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:47:13.349681 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 502/989] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:47:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:47:13.355668 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13da7fc-3621-4fd7-ac9c-0764096604ed None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:47:13.356167 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13da7fc-3621-4fd7-ac9c-0764096604ed None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:47:13.356273 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13da7fc-3621-4fd7-ac9c-0764096604ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:47:13.439584 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-e13da7fc-3621-4fd7-ac9c-0764096604ed None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:47:13.440689 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-e13da7fc-3621-4fd7-ac9c-0764096604ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:47:13.547378 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 488/990] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:47:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:47:13.825288 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20350e8d-263e-4b2e-97ea-fd6be3562843 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:47:13.826856 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-20350e8d-263e-4b2e-97ea-fd6be3562843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:47:13.935769 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20350e8d-263e-4b2e-97ea-fd6be3562843 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:47:14.006946 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:47:14.009326 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3225bd-fb75-42d9-b8ea-bf7892fe70e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04804cfc28b84d398ef06e8e113a755d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:47:14.010721 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3225bd-fb75-42d9-b8ea-bf7892fe70e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:47:14.011232 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3225bd-fb75-42d9-b8ea-bf7892fe70e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:47:14.011825 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3225bd-fb75-42d9-b8ea-bf7892fe70e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:47:14.013484 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-4a3225bd-fb75-42d9-b8ea-bf7892fe70e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:47:14.122717 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3225bd-fb75-42d9-b8ea-bf7892fe70e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:47:14.124143 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3225bd-fb75-42d9-b8ea-bf7892fe70e7 service neutron] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:47:14.143781 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 503/991] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:47:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 00:47:16.565844 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86404393-3ace-4a6d-a57e-37a6390ebd49 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:47:16.566378 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86404393-3ace-4a6d-a57e-37a6390ebd49 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:47:16.566378 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86404393-3ace-4a6d-a57e-37a6390ebd49 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:47:16.567868 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 489/992] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:47:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:47:16.573029 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd6061-1c88-4810-a432-9fdb346f514a None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:47:16.573452 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd6061-1c88-4810-a432-9fdb346f514a None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:47:16.573580 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd6061-1c88-4810-a432-9fdb346f514a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:47:16.638043 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-87cd6061-1c88-4810-a432-9fdb346f514a None None] MFA Rules not processed for user `72a99e5944964a5d98351e82622879c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:47:16.639266 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-87cd6061-1c88-4810-a432-9fdb346f514a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:47:16.690329 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:47:16.734637 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 504/993] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:47:16 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:47:17.016778 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86404393-3ace-4a6d-a57e-37a6390ebd49 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:47:17.018328 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-86404393-3ace-4a6d-a57e-37a6390ebd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:47:17.029304 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:47:17.118809 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86404393-3ace-4a6d-a57e-37a6390ebd49 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:47:17.191089 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a9d70-cba7-41c8-85e9-6d9baa9f7662 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04804cfc28b84d398ef06e8e113a755d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:47:17.191678 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a9d70-cba7-41c8-85e9-6d9baa9f7662 service neutron] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:47:17.191950 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a9d70-cba7-41c8-85e9-6d9baa9f7662 service neutron] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:47:17.192214 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a9d70-cba7-41c8-85e9-6d9baa9f7662 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:47:17.193763 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-670a9d70-cba7-41c8-85e9-6d9baa9f7662 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:47:17.255386 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:47:17.302690 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a9d70-cba7-41c8-85e9-6d9baa9f7662 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:47:17.304058 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a9d70-cba7-41c8-85e9-6d9baa9f7662 service neutron] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:47:17.321402 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 490/994] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:47:17 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:47:19.992817 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f80834-e682-4fbf-8136-2043b4e1fdbf None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:47:19.993399 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f80834-e682-4fbf-8136-2043b4e1fdbf None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:47:19.993399 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f80834-e682-4fbf-8136-2043b4e1fdbf None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:47:19.994814 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 505/995] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:47:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:47:20.000052 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5088ceb-776a-42ad-9a43-43284c197e66 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:47:20.000478 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5088ceb-776a-42ad-9a43-43284c197e66 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:47:20.000610 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5088ceb-776a-42ad-9a43-43284c197e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:47:20.065063 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-f5088ceb-776a-42ad-9a43-43284c197e66 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:47:20.066308 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-f5088ceb-776a-42ad-9a43-43284c197e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:47:20.161086 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 491/996] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:47:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:47:20.446270 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f80834-e682-4fbf-8136-2043b4e1fdbf None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:47:20.448419 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-78f80834-e682-4fbf-8136-2043b4e1fdbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:47:20.549129 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f80834-e682-4fbf-8136-2043b4e1fdbf None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:47:20.621639 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf83f5-f2b5-42e7-b461-aa6c62e71861 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04804cfc28b84d398ef06e8e113a755d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:47:20.622258 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf83f5-f2b5-42e7-b461-aa6c62e71861 service neutron] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:47:20.622536 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf83f5-f2b5-42e7-b461-aa6c62e71861 service neutron] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:47:20.622800 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf83f5-f2b5-42e7-b461-aa6c62e71861 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:47:20.624355 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-91bf83f5-f2b5-42e7-b461-aa6c62e71861 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:47:20.631009 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:47:20.730890 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf83f5-f2b5-42e7-b461-aa6c62e71861 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:47:20.732250 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf83f5-f2b5-42e7-b461-aa6c62e71861 service neutron] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:47:20.750219 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 506/997] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:47:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:47:23.529457 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09c2de-cd5f-4328-8043-d0897ef4a9ec None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:47:23.530005 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09c2de-cd5f-4328-8043-d0897ef4a9ec None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:47:23.530113 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09c2de-cd5f-4328-8043-d0897ef4a9ec None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:47:23.531417 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 492/998] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:47:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:47:23.536942 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5eb2b-ab94-4df5-b632-90757792664e None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:47:23.537364 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5eb2b-ab94-4df5-b632-90757792664e None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:47:23.537501 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5eb2b-ab94-4df5-b632-90757792664e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:47:23.612537 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-7cc5eb2b-ab94-4df5-b632-90757792664e None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:47:23.613785 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-7cc5eb2b-ab94-4df5-b632-90757792664e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:47:23.685868 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:47:23.728604 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 507/999] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:47:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:47:24.017975 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09c2de-cd5f-4328-8043-d0897ef4a9ec None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:47:24.019586 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-5f09c2de-cd5f-4328-8043-d0897ef4a9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:47:24.039729 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:47:24.124762 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09c2de-cd5f-4328-8043-d0897ef4a9ec None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:47:24.199212 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb6928e-c405-4de8-a45c-0d53c0660c16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04804cfc28b84d398ef06e8e113a755d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:47:24.199838 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6928e-c405-4de8-a45c-0d53c0660c16 service neutron] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:47:24.200115 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6928e-c405-4de8-a45c-0d53c0660c16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:47:24.200381 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6928e-c405-4de8-a45c-0d53c0660c16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:47:24.201955 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-0cb6928e-c405-4de8-a45c-0d53c0660c16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:47:24.273526 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:47:24.311570 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb6928e-c405-4de8-a45c-0d53c0660c16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:47:24.313021 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb6928e-c405-4de8-a45c-0d53c0660c16 service neutron] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:47:24.331461 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 493/1000] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:47:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:47:26.550175 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993cacb-6f51-4155-94e3-52fc1a46a890 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:47:26.550706 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993cacb-6f51-4155-94e3-52fc1a46a890 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:47:26.550706 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993cacb-6f51-4155-94e3-52fc1a46a890 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:47:26.552009 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 508/1001] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:47:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:47:26.557890 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4bc31-d324-4b87-82ec-880da1bfdd01 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:47:26.558342 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4bc31-d324-4b87-82ec-880da1bfdd01 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:47:26.558573 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4bc31-d324-4b87-82ec-880da1bfdd01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:47:26.634746 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-e3a4bc31-d324-4b87-82ec-880da1bfdd01 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:47:26.635976 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-e3a4bc31-d324-4b87-82ec-880da1bfdd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:47:26.733117 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 494/1002] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:47:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:47:27.019297 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4993cacb-6f51-4155-94e3-52fc1a46a890 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:47:27.020834 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-4993cacb-6f51-4155-94e3-52fc1a46a890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:47:27.125249 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4993cacb-6f51-4155-94e3-52fc1a46a890 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:47:27.200103 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63355192-16fd-4396-8001-dd8ab4247d00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04804cfc28b84d398ef06e8e113a755d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:47:27.200712 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63355192-16fd-4396-8001-dd8ab4247d00 service neutron] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:47:27.200993 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63355192-16fd-4396-8001-dd8ab4247d00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:47:27.201264 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63355192-16fd-4396-8001-dd8ab4247d00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:47:27.202901 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-63355192-16fd-4396-8001-dd8ab4247d00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:47:27.221032 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:47:27.317259 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63355192-16fd-4396-8001-dd8ab4247d00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:47:27.318707 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63355192-16fd-4396-8001-dd8ab4247d00 service neutron] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:47:27.337708 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 509/1003] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:47:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:47:29.559640 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1811b-7fd3-4e21-885f-752e74ce5592 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:47:29.560083 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1811b-7fd3-4e21-885f-752e74ce5592 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:47:29.560176 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1811b-7fd3-4e21-885f-752e74ce5592 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:47:29.561526 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 495/1004] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:47:29.566842 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76aa83b-6eb7-447e-87ab-b49c79cf36a9 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:47:29.567224 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76aa83b-6eb7-447e-87ab-b49c79cf36a9 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:47:29.567538 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76aa83b-6eb7-447e-87ab-b49c79cf36a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:47:29.636858 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-f76aa83b-6eb7-447e-87ab-b49c79cf36a9 None None] MFA Rules not processed for user `72a99e5944964a5d98351e82622879c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:47:29.638123 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-f76aa83b-6eb7-447e-87ab-b49c79cf36a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:47:29.704604 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:47:29.738794 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 510/1005] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:47:29 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:47:30.023432 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd1811b-7fd3-4e21-885f-752e74ce5592 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:47:30.025483 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-2bd1811b-7fd3-4e21-885f-752e74ce5592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:47:30.057203 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:47:30.130809 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd1811b-7fd3-4e21-885f-752e74ce5592 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:47:30.204711 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6f7db-081b-49b0-97ad-bca25731fe4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04804cfc28b84d398ef06e8e113a755d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:47:30.205322 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6f7db-081b-49b0-97ad-bca25731fe4b service neutron] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:47:30.205606 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6f7db-081b-49b0-97ad-bca25731fe4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:47:30.205881 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6f7db-081b-49b0-97ad-bca25731fe4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:47:30.207550 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-4de6f7db-081b-49b0-97ad-bca25731fe4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:47:30.286591 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:47:30.319036 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6f7db-081b-49b0-97ad-bca25731fe4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:47:30.320531 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6f7db-081b-49b0-97ad-bca25731fe4b service neutron] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:47:30.339279 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 496/1006] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:47:30 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:47:32.736371 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f6548-1370-44bd-95c0-0928ad502b70 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:47:32.736898 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f6548-1370-44bd-95c0-0928ad502b70 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:47:32.736898 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f6548-1370-44bd-95c0-0928ad502b70 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:47:32.738289 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 511/1007] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:47:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:47:32.743416 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bdd581-bf4c-47ff-8ed5-2ba6fe04bc85 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:47:32.743812 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bdd581-bf4c-47ff-8ed5-2ba6fe04bc85 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:47:32.744004 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bdd581-bf4c-47ff-8ed5-2ba6fe04bc85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:47:32.809916 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-d0bdd581-bf4c-47ff-8ed5-2ba6fe04bc85 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:47:32.811147 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-d0bdd581-bf4c-47ff-8ed5-2ba6fe04bc85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:47:32.904999 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 497/1008] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:47:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:47:33.194039 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f6548-1370-44bd-95c0-0928ad502b70 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:47:33.195630 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-9c1f6548-1370-44bd-95c0-0928ad502b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:47:33.299438 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f6548-1370-44bd-95c0-0928ad502b70 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:47:33.372027 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499c7d4-ba63-45a3-890c-ed56ef0b5a60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04804cfc28b84d398ef06e8e113a755d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:47:33.372626 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499c7d4-ba63-45a3-890c-ed56ef0b5a60 service neutron] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:47:33.372907 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499c7d4-ba63-45a3-890c-ed56ef0b5a60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:47:33.373181 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499c7d4-ba63-45a3-890c-ed56ef0b5a60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:47:33.374813 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-1499c7d4-ba63-45a3-890c-ed56ef0b5a60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:47:33.402608 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:47:33.484082 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1499c7d4-ba63-45a3-890c-ed56ef0b5a60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:47:33.485519 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1499c7d4-ba63-45a3-890c-ed56ef0b5a60 service neutron] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:47:33.503499 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 512/1009] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:47:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:47:35.682662 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741c530-2a4e-4624-869d-da638b649341 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:47:35.683241 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741c530-2a4e-4624-869d-da638b649341 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:47:35.683241 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741c530-2a4e-4624-869d-da638b649341 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:47:35.684543 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 498/1010] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:47:35.689856 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8eed4e-9000-4e82-a415-95d717e0dbec None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:47:35.690333 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8eed4e-9000-4e82-a415-95d717e0dbec None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:47:35.690435 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8eed4e-9000-4e82-a415-95d717e0dbec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:47:35.755848 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-ee8eed4e-9000-4e82-a415-95d717e0dbec None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:47:35.756992 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-ee8eed4e-9000-4e82-a415-95d717e0dbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:47:35.831420 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:47:35.854148 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 513/1011] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:47:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:47:36.137310 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741c530-2a4e-4624-869d-da638b649341 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:47:36.138871 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-5741c530-2a4e-4624-869d-da638b649341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:47:36.177797 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:47:36.240036 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741c530-2a4e-4624-869d-da638b649341 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:47:36.312104 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ce9d4-7f67-42c4-a768-4eeeecd7f631 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04804cfc28b84d398ef06e8e113a755d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:47:36.312694 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ce9d4-7f67-42c4-a768-4eeeecd7f631 service neutron] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:47:36.312971 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ce9d4-7f67-42c4-a768-4eeeecd7f631 service neutron] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:47:36.313236 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ce9d4-7f67-42c4-a768-4eeeecd7f631 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:47:36.314834 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-f67ce9d4-7f67-42c4-a768-4eeeecd7f631 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:47:36.398096 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:47:36.424023 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67ce9d4-7f67-42c4-a768-4eeeecd7f631 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:47:36.425456 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67ce9d4-7f67-42c4-a768-4eeeecd7f631 service neutron] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:47:36.446450 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 499/1012] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:47:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:47:38.883060 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38019a21-324f-4536-bbbb-1cc65442c827 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:47:38.883636 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38019a21-324f-4536-bbbb-1cc65442c827 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:47:38.883636 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38019a21-324f-4536-bbbb-1cc65442c827 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:47:38.884960 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 514/1013] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:47:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:47:38.890795 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bf359-3cee-4324-8a6e-b22f66b63e64 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:47:38.891304 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bf359-3cee-4324-8a6e-b22f66b63e64 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:47:38.891441 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bf359-3cee-4324-8a6e-b22f66b63e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:47:38.963519 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-d97bf359-3cee-4324-8a6e-b22f66b63e64 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:47:38.964738 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-d97bf359-3cee-4324-8a6e-b22f66b63e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:47:39.059442 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 500/1014] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:47:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:47:39.341537 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38019a21-324f-4536-bbbb-1cc65442c827 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:47:39.343107 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-38019a21-324f-4536-bbbb-1cc65442c827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:47:39.444691 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38019a21-324f-4536-bbbb-1cc65442c827 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:47:39.518078 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b904ed4-0be4-48bb-b24b-09ea08978762 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04804cfc28b84d398ef06e8e113a755d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:47:39.518707 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b904ed4-0be4-48bb-b24b-09ea08978762 service neutron] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:47:39.518986 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b904ed4-0be4-48bb-b24b-09ea08978762 service neutron] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:47:39.519257 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b904ed4-0be4-48bb-b24b-09ea08978762 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:47:39.520825 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-2b904ed4-0be4-48bb-b24b-09ea08978762 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:47:39.555816 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:47:39.628181 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b904ed4-0be4-48bb-b24b-09ea08978762 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:47:39.629620 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b904ed4-0be4-48bb-b24b-09ea08978762 service neutron] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:47:39.647823 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 515/1015] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:47:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:47:43.677894 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169fd9d-152d-4741-9f98-a6016d7b7f21 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:47:43.678445 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169fd9d-152d-4741-9f98-a6016d7b7f21 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:47:43.678558 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169fd9d-152d-4741-9f98-a6016d7b7f21 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:47:43.680427 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 501/1016] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:47:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:47:43.685940 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c097a-792e-4ff2-bbc9-b3f48e4f8dbb None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:47:43.686379 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c097a-792e-4ff2-bbc9-b3f48e4f8dbb None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:47:43.686528 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c097a-792e-4ff2-bbc9-b3f48e4f8dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:47:43.752218 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-c68c097a-792e-4ff2-bbc9-b3f48e4f8dbb None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:47:43.753353 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-c68c097a-792e-4ff2-bbc9-b3f48e4f8dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:47:43.839474 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:47:43.851820 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 516/1017] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:47:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:47:44.136931 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169fd9d-152d-4741-9f98-a6016d7b7f21 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:47:44.138481 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-d169fd9d-152d-4741-9f98-a6016d7b7f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:47:44.187332 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:47:44.245319 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169fd9d-152d-4741-9f98-a6016d7b7f21 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:47:44.317461 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8202f1f6-2613-40d5-b87e-7ce6afb0bc5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04804cfc28b84d398ef06e8e113a755d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:47:44.318062 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202f1f6-2613-40d5-b87e-7ce6afb0bc5a service neutron] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:47:44.318372 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202f1f6-2613-40d5-b87e-7ce6afb0bc5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:47:44.318643 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202f1f6-2613-40d5-b87e-7ce6afb0bc5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:47:44.320836 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-8202f1f6-2613-40d5-b87e-7ce6afb0bc5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:47:44.413222 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:47:44.430846 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8202f1f6-2613-40d5-b87e-7ce6afb0bc5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:47:44.432360 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8202f1f6-2613-40d5-b87e-7ce6afb0bc5a service neutron] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:47:44.451684 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 502/1018] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:47:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:47:47.260111 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170a95a-e14f-4691-a7dd-299b2a466d85 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:47:47.260635 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170a95a-e14f-4691-a7dd-299b2a466d85 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:47:47.260635 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170a95a-e14f-4691-a7dd-299b2a466d85 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:47:47.262008 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 517/1019] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:47:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:47:47.267093 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8976e7-8ed8-4734-8c95-9226e8bd4c89 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:47:47.267514 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8976e7-8ed8-4734-8c95-9226e8bd4c89 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:47:47.267642 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8976e7-8ed8-4734-8c95-9226e8bd4c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:47:47.334372 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-0f8976e7-8ed8-4734-8c95-9226e8bd4c89 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:47:47.335620 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-0f8976e7-8ed8-4734-8c95-9226e8bd4c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:47:47.433677 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 503/1020] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:47:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:47:47.717542 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170a95a-e14f-4691-a7dd-299b2a466d85 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:47:47.719104 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-9170a95a-e14f-4691-a7dd-299b2a466d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:47:47.826928 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170a95a-e14f-4691-a7dd-299b2a466d85 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:47:47.899024 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0b234-41cb-4e6b-bbfa-965a1534b07e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04804cfc28b84d398ef06e8e113a755d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:47:47.899628 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0b234-41cb-4e6b-bbfa-965a1534b07e service neutron] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:47:47.899908 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0b234-41cb-4e6b-bbfa-965a1534b07e service neutron] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:47:47.900181 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0b234-41cb-4e6b-bbfa-965a1534b07e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:47:47.901777 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-cbc0b234-41cb-4e6b-bbfa-965a1534b07e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:47:47.946428 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:47:48.017679 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc0b234-41cb-4e6b-bbfa-965a1534b07e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:47:48.019175 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc0b234-41cb-4e6b-bbfa-965a1534b07e service neutron] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:47:48.038817 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 518/1021] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:47:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:47:52.149715 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a094156-8341-48ab-b1d8-de67dd492e6c None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:47:52.150205 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a094156-8341-48ab-b1d8-de67dd492e6c None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:47:52.150314 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a094156-8341-48ab-b1d8-de67dd492e6c None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:47:52.151645 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 504/1022] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:47:52.157018 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72778547-f37d-45b1-a293-e21015bf7c5f None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:47:52.157470 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72778547-f37d-45b1-a293-e21015bf7c5f None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:47:52.157561 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72778547-f37d-45b1-a293-e21015bf7c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:47:52.226499 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-72778547-f37d-45b1-a293-e21015bf7c5f None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:47:52.227998 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-72778547-f37d-45b1-a293-e21015bf7c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:47:52.324682 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:47:52.326956 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 519/1023] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:47:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:47:52.606921 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a094156-8341-48ab-b1d8-de67dd492e6c None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:47:52.608494 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-8a094156-8341-48ab-b1d8-de67dd492e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:47:52.665368 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:47:52.712533 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a094156-8341-48ab-b1d8-de67dd492e6c None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:47:52.783808 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67308b-99ab-4da9-aa68-6ab22b458108 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04804cfc28b84d398ef06e8e113a755d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:47:52.784400 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67308b-99ab-4da9-aa68-6ab22b458108 service neutron] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:47:52.784679 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67308b-99ab-4da9-aa68-6ab22b458108 service neutron] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:47:52.784949 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67308b-99ab-4da9-aa68-6ab22b458108 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:47:52.786561 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-7e67308b-99ab-4da9-aa68-6ab22b458108 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:47:52.890131 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:47:52.894296 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e67308b-99ab-4da9-aa68-6ab22b458108 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:47:52.895726 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e67308b-99ab-4da9-aa68-6ab22b458108 service neutron] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:47:52.913700 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 505/1024] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:47:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:47:57.707645 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb4e08-617a-4cee-890a-85dfa1c7aed7 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:47:57.708060 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb4e08-617a-4cee-890a-85dfa1c7aed7 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:47:57.708255 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb4e08-617a-4cee-890a-85dfa1c7aed7 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:47:57.710121 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 520/1025] 10.222.0.23 () {54 vars in 921 bytes} [Sun Oct 23 00:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:47:57.715225 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22690996-d5c9-415f-9a84-d46249e66d04 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:47:57.715625 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22690996-d5c9-415f-9a84-d46249e66d04 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:47:57.715803 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22690996-d5c9-415f-9a84-d46249e66d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:47:57.815059 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-22690996-d5c9-415f-9a84-d46249e66d04 None None] MFA Rules not processed for user `1863d19ad4624ea496c2c73b70ae0c6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:47:57.816315 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-22690996-d5c9-415f-9a84-d46249e66d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:47:58.003134 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 506/1026] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Oct 23 00:47:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:48:02.185314 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4d9a2-b87c-4708-ab06-780795db2e9b None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:02.185857 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4d9a2-b87c-4708-ab06-780795db2e9b None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:02.185857 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4d9a2-b87c-4708-ab06-780795db2e9b None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:02.187449 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 521/1027] 10.222.0.23 () {54 vars in 921 bytes} [Sun Oct 23 00:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:48:02.192652 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8875e0-b9fd-437c-ad8d-583b96c18b8d None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:02.193084 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8875e0-b9fd-437c-ad8d-583b96c18b8d None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:02.193239 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8875e0-b9fd-437c-ad8d-583b96c18b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:02.254256 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:48:02.277907 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-2b8875e0-b9fd-437c-ad8d-583b96c18b8d None None] MFA Rules not processed for user `1863d19ad4624ea496c2c73b70ae0c6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:48:02.279174 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-2b8875e0-b9fd-437c-ad8d-583b96c18b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:02.387149 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 507/1028] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Oct 23 00:48:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:48:03.710934 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267e6c9-94d5-4977-b110-dc0610fdb109 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:03.711458 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267e6c9-94d5-4977-b110-dc0610fdb109 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:03.711580 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267e6c9-94d5-4977-b110-dc0610fdb109 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:03.712834 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 522/1029] 10.222.0.23 () {54 vars in 921 bytes} [Sun Oct 23 00:48:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:48:03.717920 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901ffea-3742-4d22-8a35-d2a86dd8f2a8 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:03.718363 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901ffea-3742-4d22-8a35-d2a86dd8f2a8 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:03.718501 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901ffea-3742-4d22-8a35-d2a86dd8f2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:03.796145 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-a901ffea-3742-4d22-8a35-d2a86dd8f2a8 None None] MFA Rules not processed for user `1863d19ad4624ea496c2c73b70ae0c6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:48:03.797284 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-a901ffea-3742-4d22-8a35-d2a86dd8f2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:03.839432 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:48:03.907409 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 508/1030] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Oct 23 00:48:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:48:07.417682 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18122f8b-6279-4bb7-b804-e42a9a745acc None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:07.418668 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18122f8b-6279-4bb7-b804-e42a9a745acc None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:07.419057 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18122f8b-6279-4bb7-b804-e42a9a745acc None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:07.420511 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 523/1031] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:48:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:48:07.425910 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f90359-d162-49ff-878c-82e4e8dc4b64 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:07.426379 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f90359-d162-49ff-878c-82e4e8dc4b64 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:07.426474 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f90359-d162-49ff-878c-82e4e8dc4b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:07.498295 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-83f90359-d162-49ff-878c-82e4e8dc4b64 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:48:07.498809 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-83f90359-d162-49ff-878c-82e4e8dc4b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:07.601747 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 509/1032] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:48:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:48:07.912252 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb1067-8602-4b9f-be99-8e2b6fbb3e2b None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:07.912638 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb1067-8602-4b9f-be99-8e2b6fbb3e2b None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:07.912821 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb1067-8602-4b9f-be99-8e2b6fbb3e2b None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:07.914357 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 524/1033] 10.222.0.23 () {54 vars in 961 bytes} [Sun Oct 23 00:48:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:48:07.925205 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac94e0-5531-4a98-b32c-edf58e1bf505 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:07.925612 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac94e0-5531-4a98-b32c-edf58e1bf505 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:07.926166 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac94e0-5531-4a98-b32c-edf58e1bf505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:07.950145 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:48:08.018115 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-c3ac94e0-5531-4a98-b32c-edf58e1bf505 None None] MFA Rules not processed for user `90f691140a8341ada73a8c6f01ad798c`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:48:08.019619 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-c3ac94e0-5531-4a98-b32c-edf58e1bf505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:08.143188 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 510/1034] 10.222.0.23 () {58 vars in 1058 bytes} [Sun Oct 23 00:48:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:48:08.151861 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb1067-8602-4b9f-be99-8e2b6fbb3e2b None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:48:08.153581 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-5deb1067-8602-4b9f-be99-8e2b6fbb3e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:08.307793 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb1067-8602-4b9f-be99-8e2b6fbb3e2b None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:48:08.387229 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:48:08.430529 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77038017-087f-4efe-8ac3-407be96ac3a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90f691140a8341ada73a8c6f01ad798c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:48:08.431202 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77038017-087f-4efe-8ac3-407be96ac3a6 service nova] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:08.431704 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77038017-087f-4efe-8ac3-407be96ac3a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:08.432075 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77038017-087f-4efe-8ac3-407be96ac3a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:08.433759 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-77038017-087f-4efe-8ac3-407be96ac3a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:08.537423 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77038017-087f-4efe-8ac3-407be96ac3a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:48:08.539222 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77038017-087f-4efe-8ac3-407be96ac3a6 service nova] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:48:08.559024 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 525/1035] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:48:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:48:10.934277 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf67b7-9b4d-4c2f-887f-1366e28bff98 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:10.934277 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf67b7-9b4d-4c2f-887f-1366e28bff98 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:10.934277 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf67b7-9b4d-4c2f-887f-1366e28bff98 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:10.940125 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 511/1036] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:48:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:48:10.948386 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0ce3c-6c36-4a57-9398-7b535448a27f None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:10.948941 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0ce3c-6c36-4a57-9398-7b535448a27f None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:10.948941 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0ce3c-6c36-4a57-9398-7b535448a27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:11.029951 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-0db0ce3c-6c36-4a57-9398-7b535448a27f None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:48:11.031350 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-0db0ce3c-6c36-4a57-9398-7b535448a27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:11.074287 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:48:11.140239 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 526/1037] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:48:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:48:11.431923 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf67b7-9b4d-4c2f-887f-1366e28bff98 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:48:11.433491 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-41cf67b7-9b4d-4c2f-887f-1366e28bff98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:11.506257 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:48:11.623309 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf67b7-9b4d-4c2f-887f-1366e28bff98 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:48:11.763447 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38ad37-835f-4ea3-8193-92052a891181 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90f691140a8341ada73a8c6f01ad798c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:48:11.763971 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38ad37-835f-4ea3-8193-92052a891181 service nova] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:11.764242 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38ad37-835f-4ea3-8193-92052a891181 service nova] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:11.764507 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38ad37-835f-4ea3-8193-92052a891181 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:11.766106 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-bf38ad37-835f-4ea3-8193-92052a891181 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:11.788705 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:48:11.860340 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38ad37-835f-4ea3-8193-92052a891181 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:48:11.861943 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38ad37-835f-4ea3-8193-92052a891181 service nova] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:48:11.880999 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 512/1038] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:48:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:48:14.357954 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a49a11-06bd-4086-a14d-80d735e5a938 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:14.358501 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a49a11-06bd-4086-a14d-80d735e5a938 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:14.358501 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a49a11-06bd-4086-a14d-80d735e5a938 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:14.362138 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 527/1039] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:48:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:48:14.365428 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0adf44-9abe-4844-8124-bba3b313c167 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:14.365845 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0adf44-9abe-4844-8124-bba3b313c167 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:14.366018 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0adf44-9abe-4844-8124-bba3b313c167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:14.435304 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-9a0adf44-9abe-4844-8124-bba3b313c167 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:48:14.436745 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-9a0adf44-9abe-4844-8124-bba3b313c167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:14.544002 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:48:14.546675 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 513/1040] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:48:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:48:14.850578 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456da990-37ad-4c41-8385-5d2cfe31da06 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:14.851061 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456da990-37ad-4c41-8385-5d2cfe31da06 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:14.851330 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456da990-37ad-4c41-8385-5d2cfe31da06 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:14.852811 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 528/1041] 10.222.0.23 () {54 vars in 961 bytes} [Sun Oct 23 00:48:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:48:14.858469 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbed9d-ff50-4f0b-8103-0c1383ccb66b None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:14.858857 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbed9d-ff50-4f0b-8103-0c1383ccb66b None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:14.859280 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbed9d-ff50-4f0b-8103-0c1383ccb66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:14.943998 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-37fbed9d-ff50-4f0b-8103-0c1383ccb66b None None] MFA Rules not processed for user `90f691140a8341ada73a8c6f01ad798c`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:48:14.945486 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-37fbed9d-ff50-4f0b-8103-0c1383ccb66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:15.075628 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 514/1042] 10.222.0.23 () {58 vars in 1058 bytes} [Sun Oct 23 00:48:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:48:15.084498 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456da990-37ad-4c41-8385-5d2cfe31da06 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:48:15.086473 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-456da990-37ad-4c41-8385-5d2cfe31da06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:15.245965 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456da990-37ad-4c41-8385-5d2cfe31da06 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:48:15.267039 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:48:15.369127 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1434a-0c7f-4bdd-a531-08f5528ee132 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90f691140a8341ada73a8c6f01ad798c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:48:15.369797 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1434a-0c7f-4bdd-a531-08f5528ee132 service nova] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:15.370066 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1434a-0c7f-4bdd-a531-08f5528ee132 service nova] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:15.370309 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1434a-0c7f-4bdd-a531-08f5528ee132 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:15.371903 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-86b1434a-0c7f-4bdd-a531-08f5528ee132 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:15.470673 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b1434a-0c7f-4bdd-a531-08f5528ee132 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:48:15.472269 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b1434a-0c7f-4bdd-a531-08f5528ee132 service nova] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:48:15.492177 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 529/1043] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:48:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:48:15.527948 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15b8a5-4cc0-4541-bfb9-acc94babf081 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:15.528467 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15b8a5-4cc0-4541-bfb9-acc94babf081 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:15.528550 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15b8a5-4cc0-4541-bfb9-acc94babf081 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:15.530023 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 515/1044] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:48:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:48:15.536892 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cacd52-35e8-46f6-b200-fab5e8dbaf9b None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:15.537613 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cacd52-35e8-46f6-b200-fab5e8dbaf9b None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:15.538135 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cacd52-35e8-46f6-b200-fab5e8dbaf9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:15.573936 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:48:15.616056 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-a2cacd52-35e8-46f6-b200-fab5e8dbaf9b None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:48:15.617307 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-a2cacd52-35e8-46f6-b200-fab5e8dbaf9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:15.740689 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 530/1045] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:48:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:48:16.071198 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ab5d6-7551-495d-827a-26134533447b None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:16.071198 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ab5d6-7551-495d-827a-26134533447b None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:16.071198 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ab5d6-7551-495d-827a-26134533447b None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:16.073302 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 516/1046] 10.222.0.23 () {54 vars in 963 bytes} [Sun Oct 23 00:48:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:48:16.076818 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c497821d-ad0b-4e08-b30b-d8fcd5549b42 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:16.077216 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c497821d-ad0b-4e08-b30b-d8fcd5549b42 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:16.077591 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c497821d-ad0b-4e08-b30b-d8fcd5549b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:16.162582 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-c497821d-ad0b-4e08-b30b-d8fcd5549b42 None None] MFA Rules not processed for user `57aa88f06f88438c8f0d4d2e65be71c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:48:16.163946 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-c497821d-ad0b-4e08-b30b-d8fcd5549b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:16.214339 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:48:16.258176 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 531/1047] 10.222.0.23 () {58 vars in 1060 bytes} [Sun Oct 23 00:48:16 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:48:16.265925 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ab5d6-7551-495d-827a-26134533447b None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:48:16.267576 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-df7ab5d6-7551-495d-827a-26134533447b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:16.324165 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:48:16.386027 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ab5d6-7551-495d-827a-26134533447b None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:48:16.476218 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597297ee-185f-46d7-9758-7d1aa591563d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57aa88f06f88438c8f0d4d2e65be71c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:48:16.476995 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597297ee-185f-46d7-9758-7d1aa591563d service cinder] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:16.477347 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597297ee-185f-46d7-9758-7d1aa591563d service cinder] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:16.477679 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597297ee-185f-46d7-9758-7d1aa591563d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:16.479525 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-597297ee-185f-46d7-9758-7d1aa591563d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:16.598835 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:48:16.614778 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597297ee-185f-46d7-9758-7d1aa591563d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:48:16.616635 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597297ee-185f-46d7-9758-7d1aa591563d service cinder] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:48:16.638314 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 517/1048] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:48:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 00:48:17.734955 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce5cf8-e8b1-4ff5-be04-88631b3d9da6 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:17.735489 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce5cf8-e8b1-4ff5-be04-88631b3d9da6 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:17.735489 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce5cf8-e8b1-4ff5-be04-88631b3d9da6 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:17.736871 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 532/1049] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:48:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:48:17.743626 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20d7c7-9e99-449d-96f2-09b1f6e8ab35 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:17.744082 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20d7c7-9e99-449d-96f2-09b1f6e8ab35 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:17.744178 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20d7c7-9e99-449d-96f2-09b1f6e8ab35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:17.808278 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-bb20d7c7-9e99-449d-96f2-09b1f6e8ab35 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:48:17.809383 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-bb20d7c7-9e99-449d-96f2-09b1f6e8ab35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:17.906404 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 518/1050] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:48:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:48:18.197989 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce5cf8-e8b1-4ff5-be04-88631b3d9da6 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:48:18.199617 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-0fce5cf8-e8b1-4ff5-be04-88631b3d9da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:18.357145 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce5cf8-e8b1-4ff5-be04-88631b3d9da6 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:48:18.409992 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:48:18.477160 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e614b68-24b6-461e-adb6-fd67079f9544 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90f691140a8341ada73a8c6f01ad798c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:48:18.477773 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e614b68-24b6-461e-adb6-fd67079f9544 service nova] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:18.478056 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e614b68-24b6-461e-adb6-fd67079f9544 service nova] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:18.478388 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e614b68-24b6-461e-adb6-fd67079f9544 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:18.479911 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-0e614b68-24b6-461e-adb6-fd67079f9544 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:18.576487 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e614b68-24b6-461e-adb6-fd67079f9544 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:48:18.578140 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e614b68-24b6-461e-adb6-fd67079f9544 service nova] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:48:18.596337 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 533/1051] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:48:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:48:20.821997 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b2c47-2ad9-485a-8889-14d44710b33d None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:20.822639 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b2c47-2ad9-485a-8889-14d44710b33d None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:20.822888 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b2c47-2ad9-485a-8889-14d44710b33d None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:20.824698 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 519/1052] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:48:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:48:20.830651 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2714e-8df5-41f9-a1f5-14fd78bde311 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:20.831179 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2714e-8df5-41f9-a1f5-14fd78bde311 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:20.831280 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2714e-8df5-41f9-a1f5-14fd78bde311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:20.904769 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-40b2714e-8df5-41f9-a1f5-14fd78bde311 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:48:20.906183 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-40b2714e-8df5-41f9-a1f5-14fd78bde311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:20.913950 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:48:21.010172 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 534/1053] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:48:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:48:21.302862 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b2c47-2ad9-485a-8889-14d44710b33d None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:48:21.304503 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-898b2c47-2ad9-485a-8889-14d44710b33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:21.370246 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:48:21.460621 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b2c47-2ad9-485a-8889-14d44710b33d None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:48:21.585822 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72564511-e2c2-442c-91c4-02f1d32ceef3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90f691140a8341ada73a8c6f01ad798c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:48:21.588469 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72564511-e2c2-442c-91c4-02f1d32ceef3 service nova] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:21.588469 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72564511-e2c2-442c-91c4-02f1d32ceef3 service nova] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:21.588469 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72564511-e2c2-442c-91c4-02f1d32ceef3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:21.589013 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-72564511-e2c2-442c-91c4-02f1d32ceef3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:21.610378 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:48:21.690798 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72564511-e2c2-442c-91c4-02f1d32ceef3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:48:21.692715 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72564511-e2c2-442c-91c4-02f1d32ceef3 service nova] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:48:21.717674 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 520/1054] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:48:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:48:23.925368 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3a431-7099-4f93-b72c-537f4941a1e7 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:23.926353 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3a431-7099-4f93-b72c-537f4941a1e7 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:23.926535 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3a431-7099-4f93-b72c-537f4941a1e7 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:23.932850 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef42f14-d395-4fe6-9a21-29b5cffb0232 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:23.933249 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef42f14-d395-4fe6-9a21-29b5cffb0232 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:23.933519 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef42f14-d395-4fe6-9a21-29b5cffb0232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:23.937974 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 535/1055] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:48:23 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:48:24.017282 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-6ef42f14-d395-4fe6-9a21-29b5cffb0232 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:48:24.018372 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-6ef42f14-d395-4fe6-9a21-29b5cffb0232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:24.130059 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:48:24.135989 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 521/1056] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:48:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:48:24.434934 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3a431-7099-4f93-b72c-537f4941a1e7 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:48:24.436525 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-8fe3a431-7099-4f93-b72c-537f4941a1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:24.595461 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:48:24.607557 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3a431-7099-4f93-b72c-537f4941a1e7 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:48:24.727066 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b459b5-541b-4c26-beae-afd1064046ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90f691140a8341ada73a8c6f01ad798c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:48:24.727582 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b459b5-541b-4c26-beae-afd1064046ab service nova] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:24.727860 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b459b5-541b-4c26-beae-afd1064046ab service nova] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:24.728128 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b459b5-541b-4c26-beae-afd1064046ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:24.729721 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-84b459b5-541b-4c26-beae-afd1064046ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:24.827960 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b459b5-541b-4c26-beae-afd1064046ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:48:24.829594 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b459b5-541b-4c26-beae-afd1064046ab service nova] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:48:24.839623 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:48:24.849370 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 536/1057] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:48:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:48:27.084845 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5c2cd-8bf9-4de7-815c-87fb9ab0602e None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:27.085552 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5c2cd-8bf9-4de7-815c-87fb9ab0602e None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:27.085552 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5c2cd-8bf9-4de7-815c-87fb9ab0602e None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:27.086747 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 522/1058] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:48:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:48:27.092124 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed7290-8089-4412-9226-fbc09a7b67a6 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:27.092596 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed7290-8089-4412-9226-fbc09a7b67a6 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:27.092683 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed7290-8089-4412-9226-fbc09a7b67a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:27.166111 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-c2ed7290-8089-4412-9226-fbc09a7b67a6 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:48:27.167336 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-c2ed7290-8089-4412-9226-fbc09a7b67a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:27.267687 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 537/1059] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:48:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:48:27.561385 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5c2cd-8bf9-4de7-815c-87fb9ab0602e None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:48:27.563017 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-97e5c2cd-8bf9-4de7-815c-87fb9ab0602e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:27.710508 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5c2cd-8bf9-4de7-815c-87fb9ab0602e None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:48:27.778354 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:48:27.826194 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38900ce4-3d40-4ba9-bc4a-3903d7e4221f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90f691140a8341ada73a8c6f01ad798c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:48:27.827226 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38900ce4-3d40-4ba9-bc4a-3903d7e4221f service nova] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:27.827507 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38900ce4-3d40-4ba9-bc4a-3903d7e4221f service nova] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:27.827792 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38900ce4-3d40-4ba9-bc4a-3903d7e4221f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:27.829473 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-38900ce4-3d40-4ba9-bc4a-3903d7e4221f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:27.928630 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38900ce4-3d40-4ba9-bc4a-3903d7e4221f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:48:27.930270 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38900ce4-3d40-4ba9-bc4a-3903d7e4221f service nova] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:48:27.952461 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 523/1060] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:48:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:48:30.104040 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ff964-7dbb-4c33-978c-e500771c2689 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:30.104642 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ff964-7dbb-4c33-978c-e500771c2689 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:30.104642 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ff964-7dbb-4c33-978c-e500771c2689 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:30.105941 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 538/1061] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:48:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:48:30.111484 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083bb8f-5c33-4751-83f8-520fd29db4b9 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:30.111881 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083bb8f-5c33-4751-83f8-520fd29db4b9 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:30.112036 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083bb8f-5c33-4751-83f8-520fd29db4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:30.178830 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-c083bb8f-5c33-4751-83f8-520fd29db4b9 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:48:30.180038 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-c083bb8f-5c33-4751-83f8-520fd29db4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:30.214253 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:48:30.284489 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 524/1062] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:48:30.579866 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ff964-7dbb-4c33-978c-e500771c2689 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:48:30.581431 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-5f1ff964-7dbb-4c33-978c-e500771c2689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:30.658610 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:48:30.733608 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ff964-7dbb-4c33-978c-e500771c2689 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:48:30.847310 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7b5f5-90ce-4c75-aeb7-5c5da0d03e14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90f691140a8341ada73a8c6f01ad798c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:48:30.847841 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7b5f5-90ce-4c75-aeb7-5c5da0d03e14 service nova] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:30.848116 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7b5f5-90ce-4c75-aeb7-5c5da0d03e14 service nova] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:30.848380 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7b5f5-90ce-4c75-aeb7-5c5da0d03e14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:30.849952 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-94e7b5f5-90ce-4c75-aeb7-5c5da0d03e14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:30.889028 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:48:30.942495 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7b5f5-90ce-4c75-aeb7-5c5da0d03e14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:48:30.944105 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7b5f5-90ce-4c75-aeb7-5c5da0d03e14 service nova] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:48:30.963023 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 539/1063] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:48:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:48:31.999287 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33e964-a9e1-4504-9e86-f3960ada2c38 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:31.999854 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33e964-a9e1-4504-9e86-f3960ada2c38 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:31.999854 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33e964-a9e1-4504-9e86-f3960ada2c38 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:32.001214 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 525/1064] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:48:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:48:32.006702 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20db0c-e40f-4562-b3a0-3def9982e2d1 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:32.007146 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20db0c-e40f-4562-b3a0-3def9982e2d1 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:32.007384 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20db0c-e40f-4562-b3a0-3def9982e2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:32.073601 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-ba20db0c-e40f-4562-b3a0-3def9982e2d1 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:48:32.074835 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-ba20db0c-e40f-4562-b3a0-3def9982e2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:32.174687 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 540/1065] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:48:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:48:32.478841 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18725b3-9732-4fb3-bd7f-68854012df27 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:32.479157 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18725b3-9732-4fb3-bd7f-68854012df27 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:32.479436 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18725b3-9732-4fb3-bd7f-68854012df27 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:32.480803 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 526/1066] 10.222.0.23 () {54 vars in 962 bytes} [Sun Oct 23 00:48:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:48:32.486163 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc8c8b-49fe-44ea-822d-c1df5feeefd4 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:32.486450 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc8c8b-49fe-44ea-822d-c1df5feeefd4 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:32.486723 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc8c8b-49fe-44ea-822d-c1df5feeefd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:32.502735 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:48:32.563997 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-6abc8c8b-49fe-44ea-822d-c1df5feeefd4 None None] MFA Rules not processed for user `1b94f1f12db3473f9ce1f33d2d9056a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:48:32.565198 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-6abc8c8b-49fe-44ea-822d-c1df5feeefd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:32.641207 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 541/1067] 10.222.0.23 () {58 vars in 1059 bytes} [Sun Oct 23 00:48:32 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:48:32.649692 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18725b3-9732-4fb3-bd7f-68854012df27 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:48:32.651390 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-a18725b3-9732-4fb3-bd7f-68854012df27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:32.759856 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18725b3-9732-4fb3-bd7f-68854012df27 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:48:32.818301 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:48:32.834580 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da9f8d-6ea1-4cf9-97f3-34e3cdbccddc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b94f1f12db3473f9ce1f33d2d9056a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:48:32.835183 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da9f8d-6ea1-4cf9-97f3-34e3cdbccddc service glance] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:32.835461 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da9f8d-6ea1-4cf9-97f3-34e3cdbccddc service glance] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:32.835730 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da9f8d-6ea1-4cf9-97f3-34e3cdbccddc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:32.837300 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-d8da9f8d-6ea1-4cf9-97f3-34e3cdbccddc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:32.946384 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8da9f8d-6ea1-4cf9-97f3-34e3cdbccddc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:48:32.947827 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8da9f8d-6ea1-4cf9-97f3-34e3cdbccddc service glance] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:48:32.965587 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 527/1068] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:48:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:48:33.145852 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c98ce3-77ed-4af2-b3eb-8041b592d43f None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:33.146462 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c98ce3-77ed-4af2-b3eb-8041b592d43f None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:33.146462 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c98ce3-77ed-4af2-b3eb-8041b592d43f None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:33.147825 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 542/1069] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:48:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:48:33.153784 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f30528-4b24-4584-bf7d-0128b9ac9450 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:33.154401 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f30528-4b24-4584-bf7d-0128b9ac9450 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:33.154553 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f30528-4b24-4584-bf7d-0128b9ac9450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:33.229103 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-a4f30528-4b24-4584-bf7d-0128b9ac9450 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:48:33.230660 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-a4f30528-4b24-4584-bf7d-0128b9ac9450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:33.271929 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:48:33.333364 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 528/1070] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:48:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:48:33.624636 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c98ce3-77ed-4af2-b3eb-8041b592d43f None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:48:33.626189 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-58c98ce3-77ed-4af2-b3eb-8041b592d43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:33.708101 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702379d-a303-4013-b36f-dafc2da001b5 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:33.708501 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702379d-a303-4013-b36f-dafc2da001b5 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:33.708846 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702379d-a303-4013-b36f-dafc2da001b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:33.731628 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:48:33.777914 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-5702379d-a303-4013-b36f-dafc2da001b5 None None] MFA Rules not processed for user `f183fd83a96a4af0bc9df03e6f61ca4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:48:33.778612 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c98ce3-77ed-4af2-b3eb-8041b592d43f None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:48:33.779187 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-5702379d-a303-4013-b36f-dafc2da001b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:33.867473 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 529/1071] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 23 00:48:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:48:33.895417 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d78db-80fd-492a-a321-df9f79572aa3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90f691140a8341ada73a8c6f01ad798c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:48:33.896024 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d78db-80fd-492a-a321-df9f79572aa3 service nova] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:33.896302 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d78db-80fd-492a-a321-df9f79572aa3 service nova] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:33.896568 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d78db-80fd-492a-a321-df9f79572aa3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:33.898278 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-e79d78db-80fd-492a-a321-df9f79572aa3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:33.911649 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96578e29-9108-46e1-aa53-d0e00564a956 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:33.912012 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96578e29-9108-46e1-aa53-d0e00564a956 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:33.912349 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96578e29-9108-46e1-aa53-d0e00564a956 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:33.913760 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 530/1072] 10.222.0.23 () {54 vars in 943 bytes} [Sun Oct 23 00:48:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:48:33.920248 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775377ff-c0e8-4dda-b1eb-9ae98fe38360 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:33.920530 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775377ff-c0e8-4dda-b1eb-9ae98fe38360 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:33.920798 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775377ff-c0e8-4dda-b1eb-9ae98fe38360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:33.964416 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:48:33.972073 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:48:33.995645 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d78db-80fd-492a-a321-df9f79572aa3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:48:33.997246 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d78db-80fd-492a-a321-df9f79572aa3 service nova] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:48:34.001395 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-775377ff-c0e8-4dda-b1eb-9ae98fe38360 None None] MFA Rules not processed for user `84a0345be05644e3a7a71c5a2bf21c41`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:48:34.003130 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-775377ff-c0e8-4dda-b1eb-9ae98fe38360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:34.015146 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 543/1073] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:48:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:48:34.118953 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 531/1074] 10.222.0.23 () {58 vars in 1040 bytes} [Sun Oct 23 00:48:33 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:48:34.128778 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d78db-80fd-492a-a321-df9f79572aa3 service nova] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:48:34.130042 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-e79d78db-80fd-492a-a321-df9f79572aa3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:34.228731 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d78db-80fd-492a-a321-df9f79572aa3 service nova] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:48:34.335448 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:48:34.337423 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d7c75-319d-4f16-95da-59be69feda6a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84a0345be05644e3a7a71c5a2bf21c41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:48:34.338097 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d7c75-319d-4f16-95da-59be69feda6a service swift] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:34.338406 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d7c75-319d-4f16-95da-59be69feda6a service swift] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:34.338857 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d7c75-319d-4f16-95da-59be69feda6a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:34.340850 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-a87d7c75-319d-4f16-95da-59be69feda6a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:34.424144 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d7c75-319d-4f16-95da-59be69feda6a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:48:34.426316 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d7c75-319d-4f16-95da-59be69feda6a service swift] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:48:34.434293 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 544/1075] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 23 00:48:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 23 00:48:36.243155 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7556e-450a-4ffa-a798-854153756db4 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:36.243714 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7556e-450a-4ffa-a798-854153756db4 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:36.243714 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7556e-450a-4ffa-a798-854153756db4 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:36.245081 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 532/1076] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:48:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:48:36.250763 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff97043-39d6-4928-a1a2-977fa708e710 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:36.251209 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff97043-39d6-4928-a1a2-977fa708e710 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:36.251391 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff97043-39d6-4928-a1a2-977fa708e710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:36.323038 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-4ff97043-39d6-4928-a1a2-977fa708e710 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:48:36.324256 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-4ff97043-39d6-4928-a1a2-977fa708e710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:36.421755 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:48:36.430468 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 545/1077] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:48:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:48:36.725974 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7556e-450a-4ffa-a798-854153756db4 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:48:36.727648 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-68b7556e-450a-4ffa-a798-854153756db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:36.826452 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:48:36.894994 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7556e-450a-4ffa-a798-854153756db4 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:48:37.021499 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26514b9-ba34-4669-ac0d-191e92b7c2c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90f691140a8341ada73a8c6f01ad798c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:48:37.022018 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26514b9-ba34-4669-ac0d-191e92b7c2c9 service nova] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:37.022326 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26514b9-ba34-4669-ac0d-191e92b7c2c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:37.022598 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26514b9-ba34-4669-ac0d-191e92b7c2c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:37.024185 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-a26514b9-ba34-4669-ac0d-191e92b7c2c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:37.086588 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:48:37.124391 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26514b9-ba34-4669-ac0d-191e92b7c2c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:48:37.125996 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26514b9-ba34-4669-ac0d-191e92b7c2c9 service nova] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:48:37.146618 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 533/1078] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:48:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:48:39.367555 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a6daf-086d-41e6-aef7-98291b305aef None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:39.368104 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a6daf-086d-41e6-aef7-98291b305aef None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:39.368104 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a6daf-086d-41e6-aef7-98291b305aef None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:39.370764 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 546/1079] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:48:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:48:39.375025 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd09cc6-b484-456d-9295-3438ffe169b1 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:39.375512 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd09cc6-b484-456d-9295-3438ffe169b1 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:39.375609 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd09cc6-b484-456d-9295-3438ffe169b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:39.451245 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-3dd09cc6-b484-456d-9295-3438ffe169b1 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:48:39.452624 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-3dd09cc6-b484-456d-9295-3438ffe169b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:39.566136 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 534/1080] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:48:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:48:39.864547 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a6daf-086d-41e6-aef7-98291b305aef None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:48:39.864547 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-8f6a6daf-086d-41e6-aef7-98291b305aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:40.022830 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a6daf-086d-41e6-aef7-98291b305aef None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:48:40.095323 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:48:40.147238 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8e3218-a2f9-4d45-8575-f0f552c4a886 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90f691140a8341ada73a8c6f01ad798c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:48:40.147851 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e3218-a2f9-4d45-8575-f0f552c4a886 service nova] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:40.148127 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e3218-a2f9-4d45-8575-f0f552c4a886 service nova] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:40.148397 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e3218-a2f9-4d45-8575-f0f552c4a886 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:40.149998 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-ce8e3218-a2f9-4d45-8575-f0f552c4a886 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:40.251801 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8e3218-a2f9-4d45-8575-f0f552c4a886 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:48:40.254258 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8e3218-a2f9-4d45-8575-f0f552c4a886 service nova] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:48:40.279454 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 547/1081] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:48:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:48:42.501804 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f1606-38fe-44c8-a000-e5ccb69384da None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:42.502358 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f1606-38fe-44c8-a000-e5ccb69384da None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:42.502358 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f1606-38fe-44c8-a000-e5ccb69384da None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:42.503686 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 535/1082] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:48:42.509070 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae9279-ccc7-4240-bc2d-d8c57925f65a None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:42.509476 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae9279-ccc7-4240-bc2d-d8c57925f65a None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:42.509624 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae9279-ccc7-4240-bc2d-d8c57925f65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:42.580593 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-c8ae9279-ccc7-4240-bc2d-d8c57925f65a None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:48:42.581919 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-c8ae9279-ccc7-4240-bc2d-d8c57925f65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:42.613557 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:48:42.686528 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 548/1083] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:48:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:48:42.976758 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f1606-38fe-44c8-a000-e5ccb69384da None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:48:42.978322 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-d59f1606-38fe-44c8-a000-e5ccb69384da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:43.019715 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:48:43.145411 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f1606-38fe-44c8-a000-e5ccb69384da None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:48:43.265662 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:48:43.274283 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efcbae4-1b1b-4f2a-b483-38d7d08f4ea6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90f691140a8341ada73a8c6f01ad798c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:48:43.274894 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efcbae4-1b1b-4f2a-b483-38d7d08f4ea6 service nova] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:43.275177 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efcbae4-1b1b-4f2a-b483-38d7d08f4ea6 service nova] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:43.275458 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efcbae4-1b1b-4f2a-b483-38d7d08f4ea6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:43.277069 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-6efcbae4-1b1b-4f2a-b483-38d7d08f4ea6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:43.379733 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efcbae4-1b1b-4f2a-b483-38d7d08f4ea6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:48:43.381358 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efcbae4-1b1b-4f2a-b483-38d7d08f4ea6 service nova] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:48:43.400285 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 536/1084] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:48:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:48:52.689859 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=30 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:48:53.397806 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=48 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:48:57.190717 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ab963-f9d9-460f-a6d6-50f1093f99f7 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:57.191295 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ab963-f9d9-460f-a6d6-50f1093f99f7 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:57.191295 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ab963-f9d9-460f-a6d6-50f1093f99f7 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:57.192693 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 549/1085] 10.222.0.23 () {54 vars in 918 bytes} [Sun Oct 23 00:48:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:48:57.198189 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b959e-d9dc-4a77-bc5f-3258ebe4d1ca None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:57.198645 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b959e-d9dc-4a77-bc5f-3258ebe4d1ca None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:57.198786 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b959e-d9dc-4a77-bc5f-3258ebe4d1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:57.273916 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-013b959e-d9dc-4a77-bc5f-3258ebe4d1ca None None] MFA Rules not processed for user `1863d19ad4624ea496c2c73b70ae0c6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:48:57.275146 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-013b959e-d9dc-4a77-bc5f-3258ebe4d1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:57.382172 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 537/1086] 10.222.0.23 () {58 vars in 1015 bytes} [Sun Oct 23 00:48:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:48:57.396394 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db84bc-ed95-4efa-be07-78beb2ce2cf1 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:57.396682 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db84bc-ed95-4efa-be07-78beb2ce2cf1 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:57.396957 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db84bc-ed95-4efa-be07-78beb2ce2cf1 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:57.398343 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 550/1087] 10.222.0.23 () {54 vars in 918 bytes} [Sun Oct 23 00:48:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:48:57.402961 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f21a00-ecc5-4892-8f4e-ab074ebd6fe1 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:48:57.403247 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f21a00-ecc5-4892-8f4e-ab074ebd6fe1 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:48:57.403520 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f21a00-ecc5-4892-8f4e-ab074ebd6fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:48:57.476143 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:48:57.479065 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-18f21a00-ecc5-4892-8f4e-ab074ebd6fe1 None None] MFA Rules not processed for user `90f691140a8341ada73a8c6f01ad798c`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:48:57.480815 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-18f21a00-ecc5-4892-8f4e-ab074ebd6fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:48:57.594706 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 538/1088] 10.222.0.23 () {58 vars in 1015 bytes} [Sun Oct 23 00:48:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:49:00.145615 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff499b-4e53-4754-9aa0-73643d88c9c5 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:00.146209 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff499b-4e53-4754-9aa0-73643d88c9c5 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:00.146209 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff499b-4e53-4754-9aa0-73643d88c9c5 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:00.147567 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 551/1089] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 00:49:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:49:00.152828 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e332d-68f2-46f9-821b-d4d1f816d670 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:00.153273 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e332d-68f2-46f9-821b-d4d1f816d670 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:00.153379 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e332d-68f2-46f9-821b-d4d1f816d670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:00.218098 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-4c6e332d-68f2-46f9-821b-d4d1f816d670 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:49:00.219327 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-4c6e332d-68f2-46f9-821b-d4d1f816d670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:00.273826 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:00.315661 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 539/1090] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 00:49:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:49:00.601542 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff499b-4e53-4754-9aa0-73643d88c9c5 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:00.603228 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-a6ff499b-4e53-4754-9aa0-73643d88c9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:00.744830 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff499b-4e53-4754-9aa0-73643d88c9c5 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:00.815012 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:00.855220 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6750f53-974c-4adf-a478-fd8ffb400316 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90f691140a8341ada73a8c6f01ad798c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:00.855754 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6750f53-974c-4adf-a478-fd8ffb400316 service nova] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:00.856033 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6750f53-974c-4adf-a478-fd8ffb400316 service nova] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:00.856304 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6750f53-974c-4adf-a478-fd8ffb400316 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:00.857883 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-f6750f53-974c-4adf-a478-fd8ffb400316 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:00.948021 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6750f53-974c-4adf-a478-fd8ffb400316 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:00.949598 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6750f53-974c-4adf-a478-fd8ffb400316 service nova] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:00.967737 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 552/1091] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:49:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:49:02.082812 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d06d94-08db-4836-80a3-e38fbdfb0f2a None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:02.083356 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d06d94-08db-4836-80a3-e38fbdfb0f2a None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:02.083356 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d06d94-08db-4836-80a3-e38fbdfb0f2a None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:02.084715 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 540/1092] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 00:49:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:49:02.089636 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02d5de-4d4f-4c0d-9ff3-f66641421606 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:02.090043 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02d5de-4d4f-4c0d-9ff3-f66641421606 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:02.090200 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02d5de-4d4f-4c0d-9ff3-f66641421606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:02.165974 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-ae02d5de-4d4f-4c0d-9ff3-f66641421606 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:49:02.167202 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-ae02d5de-4d4f-4c0d-9ff3-f66641421606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:02.194015 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:02.262669 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 553/1093] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 00:49:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:49:02.411235 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d06d94-08db-4836-80a3-e38fbdfb0f2a None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:02.412774 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-47d06d94-08db-4836-80a3-e38fbdfb0f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:02.556295 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d06d94-08db-4836-80a3-e38fbdfb0f2a None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:02.596438 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:02.667179 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf9553-d088-40e6-a6e4-fe99ad02e513 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90f691140a8341ada73a8c6f01ad798c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:02.667709 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf9553-d088-40e6-a6e4-fe99ad02e513 service nova] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:02.667989 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf9553-d088-40e6-a6e4-fe99ad02e513 service nova] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:02.668262 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf9553-d088-40e6-a6e4-fe99ad02e513 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:02.669839 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-dfdf9553-d088-40e6-a6e4-fe99ad02e513 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:02.757159 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf9553-d088-40e6-a6e4-fe99ad02e513 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:02.758777 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf9553-d088-40e6-a6e4-fe99ad02e513 service nova] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:02.776765 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 541/1094] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:49:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:49:03.888576 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829450f8-e57c-46a1-989b-851906736ad1 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:03.889093 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829450f8-e57c-46a1-989b-851906736ad1 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:03.889209 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829450f8-e57c-46a1-989b-851906736ad1 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:03.890540 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 554/1095] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 00:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:49:03.895532 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de266f5-4a2d-4c82-8325-5f2e2c8d6fa1 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:03.895942 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de266f5-4a2d-4c82-8325-5f2e2c8d6fa1 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:03.896058 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de266f5-4a2d-4c82-8325-5f2e2c8d6fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:03.950871 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:03.972933 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-1de266f5-4a2d-4c82-8325-5f2e2c8d6fa1 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:49:03.974156 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-1de266f5-4a2d-4c82-8325-5f2e2c8d6fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:04.068656 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 542/1096] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 00:49:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:49:04.216912 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829450f8-e57c-46a1-989b-851906736ad1 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:04.218358 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-829450f8-e57c-46a1-989b-851906736ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:04.363866 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829450f8-e57c-46a1-989b-851906736ad1 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:04.375658 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:04.475288 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0fc0f4-7bfe-46d4-b134-4285a0b1086d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90f691140a8341ada73a8c6f01ad798c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:04.475813 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0fc0f4-7bfe-46d4-b134-4285a0b1086d service nova] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:04.476091 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0fc0f4-7bfe-46d4-b134-4285a0b1086d service nova] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:04.476367 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0fc0f4-7bfe-46d4-b134-4285a0b1086d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:04.477953 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-0b0fc0f4-7bfe-46d4-b134-4285a0b1086d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:04.565714 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0fc0f4-7bfe-46d4-b134-4285a0b1086d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:04.567324 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0fc0f4-7bfe-46d4-b134-4285a0b1086d service nova] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:04.584704 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 555/1097] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:49:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:49:05.683526 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c09fb-34d1-4537-b9eb-015c92dce04f None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:05.684088 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c09fb-34d1-4537-b9eb-015c92dce04f None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:05.684088 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c09fb-34d1-4537-b9eb-015c92dce04f None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:05.685415 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 543/1098] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 00:49:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:49:05.690916 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6705fe1-62e8-48c1-8cc0-1405629dfae8 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:05.691331 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6705fe1-62e8-48c1-8cc0-1405629dfae8 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:05.691474 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6705fe1-62e8-48c1-8cc0-1405629dfae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:05.711640 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:05.769245 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-d6705fe1-62e8-48c1-8cc0-1405629dfae8 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:49:05.770481 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-d6705fe1-62e8-48c1-8cc0-1405629dfae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:05.865857 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 556/1099] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 00:49:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:49:06.015828 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c09fb-34d1-4537-b9eb-015c92dce04f None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:06.017332 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-e41c09fb-34d1-4537-b9eb-015c92dce04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:06.127597 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:06.163591 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c09fb-34d1-4537-b9eb-015c92dce04f None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:06.274794 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98df75-5031-4104-8b5d-2a1b3656b72e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90f691140a8341ada73a8c6f01ad798c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:06.275395 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98df75-5031-4104-8b5d-2a1b3656b72e service nova] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:06.275678 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98df75-5031-4104-8b5d-2a1b3656b72e service nova] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:06.275946 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98df75-5031-4104-8b5d-2a1b3656b72e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:06.277559 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-af98df75-5031-4104-8b5d-2a1b3656b72e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:06.352225 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:06.366911 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af98df75-5031-4104-8b5d-2a1b3656b72e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:06.368514 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af98df75-5031-4104-8b5d-2a1b3656b72e service nova] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:06.386184 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 544/1100] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:49:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:49:07.483405 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b8226-f5d8-43cc-ab16-b5e12a6b53b0 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:07.483959 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b8226-f5d8-43cc-ab16-b5e12a6b53b0 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:07.483959 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b8226-f5d8-43cc-ab16-b5e12a6b53b0 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:07.485205 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 557/1101] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 00:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:49:07.491250 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec78363-b8bf-4b18-99a8-53b4ee341b1e None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:07.491660 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec78363-b8bf-4b18-99a8-53b4ee341b1e None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:07.491804 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec78363-b8bf-4b18-99a8-53b4ee341b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:07.566993 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-6ec78363-b8bf-4b18-99a8-53b4ee341b1e None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:49:07.568199 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-6ec78363-b8bf-4b18-99a8-53b4ee341b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:07.663488 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 545/1102] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 00:49:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:49:07.814542 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b8226-f5d8-43cc-ab16-b5e12a6b53b0 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:07.815973 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-6c9b8226-f5d8-43cc-ab16-b5e12a6b53b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:07.899500 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:07.964305 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b8226-f5d8-43cc-ab16-b5e12a6b53b0 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:08.074564 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2889e5e5-16ce-4db9-9a25-cd2addf82e58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90f691140a8341ada73a8c6f01ad798c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:08.075087 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889e5e5-16ce-4db9-9a25-cd2addf82e58 service nova] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:08.075363 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889e5e5-16ce-4db9-9a25-cd2addf82e58 service nova] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:08.075636 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889e5e5-16ce-4db9-9a25-cd2addf82e58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:08.077285 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-2889e5e5-16ce-4db9-9a25-cd2addf82e58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:08.125509 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:08.168298 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2889e5e5-16ce-4db9-9a25-cd2addf82e58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:08.169918 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2889e5e5-16ce-4db9-9a25-cd2addf82e58 service nova] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:08.187857 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 558/1103] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:49:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:49:09.230777 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02790d21-3891-48f6-a0b4-731ee6dd244f None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:09.231244 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02790d21-3891-48f6-a0b4-731ee6dd244f None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:09.231340 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02790d21-3891-48f6-a0b4-731ee6dd244f None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:09.232673 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 546/1104] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 00:49:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:49:09.237639 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff92e2b-211b-42e2-adda-c407bd0a4b79 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:09.238065 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff92e2b-211b-42e2-adda-c407bd0a4b79 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:09.238245 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff92e2b-211b-42e2-adda-c407bd0a4b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:09.315266 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-7ff92e2b-211b-42e2-adda-c407bd0a4b79 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:49:09.316475 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-7ff92e2b-211b-42e2-adda-c407bd0a4b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:09.411186 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 559/1105] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 00:49:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:49:09.561580 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02790d21-3891-48f6-a0b4-731ee6dd244f None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:09.563151 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-02790d21-3891-48f6-a0b4-731ee6dd244f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:09.610395 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:09.705619 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02790d21-3891-48f6-a0b4-731ee6dd244f None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:09.813610 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae89b21-b1d0-47fb-ad11-374409a607b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90f691140a8341ada73a8c6f01ad798c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:09.814193 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae89b21-b1d0-47fb-ad11-374409a607b6 service nova] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:09.814473 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae89b21-b1d0-47fb-ad11-374409a607b6 service nova] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:09.814738 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae89b21-b1d0-47fb-ad11-374409a607b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:09.816296 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-3ae89b21-b1d0-47fb-ad11-374409a607b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:09.822945 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:09.904633 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae89b21-b1d0-47fb-ad11-374409a607b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:09.906300 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae89b21-b1d0-47fb-ad11-374409a607b6 service nova] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:09.924402 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 547/1106] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:49:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:49:10.958964 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d3ab0-6083-4bf4-8f3c-dc7bc494f350 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:10.959505 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d3ab0-6083-4bf4-8f3c-dc7bc494f350 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:10.959505 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d3ab0-6083-4bf4-8f3c-dc7bc494f350 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:10.960872 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 560/1107] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 00:49:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:49:10.965796 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47117c2a-ccc5-4ba5-9973-ea7e61334414 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:10.966196 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47117c2a-ccc5-4ba5-9973-ea7e61334414 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:10.966387 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47117c2a-ccc5-4ba5-9973-ea7e61334414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:11.040220 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-47117c2a-ccc5-4ba5-9973-ea7e61334414 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:49:11.041413 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-47117c2a-ccc5-4ba5-9973-ea7e61334414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:11.107737 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:11.136142 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 548/1108] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 00:49:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:49:11.287940 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d3ab0-6083-4bf4-8f3c-dc7bc494f350 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:11.289451 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-584d3ab0-6083-4bf4-8f3c-dc7bc494f350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:11.307362 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:11.433943 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d3ab0-6083-4bf4-8f3c-dc7bc494f350 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:11.522863 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:11.548447 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881040a-eece-4be4-aa24-d816de7f78e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90f691140a8341ada73a8c6f01ad798c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:11.549101 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881040a-eece-4be4-aa24-d816de7f78e9 service nova] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:11.549380 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881040a-eece-4be4-aa24-d816de7f78e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:11.549653 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881040a-eece-4be4-aa24-d816de7f78e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:11.551303 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-0881040a-eece-4be4-aa24-d816de7f78e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:11.643323 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881040a-eece-4be4-aa24-d816de7f78e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:11.644927 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881040a-eece-4be4-aa24-d816de7f78e9 service nova] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:11.662727 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 561/1109] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:49:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:49:12.695021 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262149d-0040-4b95-8194-6ba96bcc6063 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:12.695560 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262149d-0040-4b95-8194-6ba96bcc6063 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:12.695560 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262149d-0040-4b95-8194-6ba96bcc6063 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:12.696940 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 549/1110] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 00:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:49:12.701683 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b3a72-adc1-4f09-8b22-5066c6e89a68 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:12.702097 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b3a72-adc1-4f09-8b22-5066c6e89a68 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:12.702275 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b3a72-adc1-4f09-8b22-5066c6e89a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:12.776451 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-702b3a72-adc1-4f09-8b22-5066c6e89a68 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:49:12.777632 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-702b3a72-adc1-4f09-8b22-5066c6e89a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:12.818241 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:12.873300 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 562/1111] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 00:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:49:13.025113 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262149d-0040-4b95-8194-6ba96bcc6063 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:13.026587 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-c262149d-0040-4b95-8194-6ba96bcc6063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:13.167576 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262149d-0040-4b95-8194-6ba96bcc6063 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:13.221407 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:13.280273 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ece2a0-5ec7-4b53-9952-01bff16aabce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90f691140a8341ada73a8c6f01ad798c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:13.280803 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ece2a0-5ec7-4b53-9952-01bff16aabce service nova] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:13.281080 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ece2a0-5ec7-4b53-9952-01bff16aabce service nova] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:13.281349 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ece2a0-5ec7-4b53-9952-01bff16aabce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:13.282952 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-b1ece2a0-5ec7-4b53-9952-01bff16aabce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:13.369967 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ece2a0-5ec7-4b53-9952-01bff16aabce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:13.371576 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ece2a0-5ec7-4b53-9952-01bff16aabce service nova] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:13.389296 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 550/1112] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:49:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:49:14.422487 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff992a-cad3-4780-9e67-1ee4dd2306ac None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:14.423548 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff992a-cad3-4780-9e67-1ee4dd2306ac None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:14.423548 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff992a-cad3-4780-9e67-1ee4dd2306ac None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:14.424923 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 563/1113] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 00:49:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:49:14.429736 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba1da1-b636-43d6-9fd0-b34aaa9f136c None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:14.430179 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba1da1-b636-43d6-9fd0-b34aaa9f136c None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:14.430324 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba1da1-b636-43d6-9fd0-b34aaa9f136c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:14.506422 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-5bba1da1-b636-43d6-9fd0-b34aaa9f136c None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:49:14.507550 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-5bba1da1-b636-43d6-9fd0-b34aaa9f136c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:14.509548 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:14.602665 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 551/1114] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 00:49:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:49:14.751733 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff992a-cad3-4780-9e67-1ee4dd2306ac None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:14.753238 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-02ff992a-cad3-4780-9e67-1ee4dd2306ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:14.899281 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff992a-cad3-4780-9e67-1ee4dd2306ac None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:14.926171 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:15.011666 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44974970-d481-40c0-b3bf-1f2b16dccf01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90f691140a8341ada73a8c6f01ad798c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:15.012259 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44974970-d481-40c0-b3bf-1f2b16dccf01 service nova] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:15.012535 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44974970-d481-40c0-b3bf-1f2b16dccf01 service nova] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:15.012802 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44974970-d481-40c0-b3bf-1f2b16dccf01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:15.014405 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-44974970-d481-40c0-b3bf-1f2b16dccf01 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:15.102213 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44974970-d481-40c0-b3bf-1f2b16dccf01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:15.103785 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44974970-d481-40c0-b3bf-1f2b16dccf01 service nova] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:15.121656 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 564/1115] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:49:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:49:17.180657 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958f983-b688-400e-a76f-b7afc3c8211c None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:17.181318 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958f983-b688-400e-a76f-b7afc3c8211c None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:17.181318 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958f983-b688-400e-a76f-b7afc3c8211c None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:17.182597 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 552/1116] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 00:49:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:49:17.187975 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3c954-b0c5-4356-8e11-13af1991a469 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:17.188445 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3c954-b0c5-4356-8e11-13af1991a469 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:17.189097 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3c954-b0c5-4356-8e11-13af1991a469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:17.228923 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:17.255312 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-39d3c954-b0c5-4356-8e11-13af1991a469 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:49:17.256514 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-39d3c954-b0c5-4356-8e11-13af1991a469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:17.350777 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 565/1117] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 00:49:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:49:17.651419 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604afe9-c67b-4006-8d3d-c3b2acfc77e9 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:17.651698 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604afe9-c67b-4006-8d3d-c3b2acfc77e9 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:17.651965 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604afe9-c67b-4006-8d3d-c3b2acfc77e9 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:17.653311 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 553/1118] 10.222.0.23 () {54 vars in 964 bytes} [Sun Oct 23 00:49:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:49:17.659573 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301a432-a402-4ae3-a11f-47b31b710b2f None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:17.659854 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301a432-a402-4ae3-a11f-47b31b710b2f None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:17.660126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301a432-a402-4ae3-a11f-47b31b710b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:17.735794 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-a301a432-a402-4ae3-a11f-47b31b710b2f None None] MFA Rules not processed for user `04804cfc28b84d398ef06e8e113a755d`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:49:17.737017 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-a301a432-a402-4ae3-a11f-47b31b710b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:17.788492 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:17.812621 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 566/1119] 10.222.0.23 () {58 vars in 1061 bytes} [Sun Oct 23 00:49:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:49:17.821517 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2604afe9-c67b-4006-8d3d-c3b2acfc77e9 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:17.823065 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-2604afe9-c67b-4006-8d3d-c3b2acfc77e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:17.926570 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2604afe9-c67b-4006-8d3d-c3b2acfc77e9 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:17.961145 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:18.003092 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675249c-70d7-4ca0-b02a-1a2fa65a172e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04804cfc28b84d398ef06e8e113a755d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:18.003692 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675249c-70d7-4ca0-b02a-1a2fa65a172e service neutron] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:18.003973 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675249c-70d7-4ca0-b02a-1a2fa65a172e service neutron] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:18.004245 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675249c-70d7-4ca0-b02a-1a2fa65a172e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:18.005865 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-d675249c-70d7-4ca0-b02a-1a2fa65a172e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:18.113198 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d675249c-70d7-4ca0-b02a-1a2fa65a172e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:18.114595 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d675249c-70d7-4ca0-b02a-1a2fa65a172e service neutron] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:18.132118 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 554/1120] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:49:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:49:20.852273 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1191a-43ba-48a7-ae9a-61ac47520ef0 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:20.852806 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1191a-43ba-48a7-ae9a-61ac47520ef0 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:20.852806 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1191a-43ba-48a7-ae9a-61ac47520ef0 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:20.854233 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 567/1121] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 00:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:49:20.859514 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89f579-1bef-4d0d-bef2-59329ccf3cad None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:20.859953 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89f579-1bef-4d0d-bef2-59329ccf3cad None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:20.860120 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89f579-1bef-4d0d-bef2-59329ccf3cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:20.928704 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-2f89f579-1bef-4d0d-bef2-59329ccf3cad None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:49:20.929915 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-2f89f579-1bef-4d0d-bef2-59329ccf3cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:20.943268 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:21.027140 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 555/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 00:49:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:49:21.312146 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1191a-43ba-48a7-ae9a-61ac47520ef0 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:21.313672 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-f0a1191a-43ba-48a7-ae9a-61ac47520ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:21.416560 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1191a-43ba-48a7-ae9a-61ac47520ef0 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:21.488380 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ce338-3b3b-4d0f-b726-b0de5a03a726 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04804cfc28b84d398ef06e8e113a755d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:21.488912 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ce338-3b3b-4d0f-b726-b0de5a03a726 service neutron] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:21.489187 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ce338-3b3b-4d0f-b726-b0de5a03a726 service neutron] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:21.489453 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ce338-3b3b-4d0f-b726-b0de5a03a726 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:21.491042 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-a05ce338-3b3b-4d0f-b726-b0de5a03a726 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:21.521833 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:21.599570 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05ce338-3b3b-4d0f-b726-b0de5a03a726 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:21.600995 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05ce338-3b3b-4d0f-b726-b0de5a03a726 service neutron] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:21.618361 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 568/1123] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:49:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:49:24.147023 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cb95f-4224-4ed8-8bf8-4e11adcdbf97 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:24.147607 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cb95f-4224-4ed8-8bf8-4e11adcdbf97 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:24.147712 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cb95f-4224-4ed8-8bf8-4e11adcdbf97 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:24.149044 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 556/1124] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 00:49:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:49:24.154535 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab18fe-bcc6-4486-a701-96686f7cd079 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:24.154955 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab18fe-bcc6-4486-a701-96686f7cd079 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:24.155110 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab18fe-bcc6-4486-a701-96686f7cd079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:24.221331 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-52ab18fe-bcc6-4486-a701-96686f7cd079 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:49:24.222574 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-52ab18fe-bcc6-4486-a701-96686f7cd079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:24.299768 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:24.319254 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 569/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 00:49:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:49:24.602904 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68cb95f-4224-4ed8-8bf8-4e11adcdbf97 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:24.604435 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-f68cb95f-4224-4ed8-8bf8-4e11adcdbf97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:24.706419 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68cb95f-4224-4ed8-8bf8-4e11adcdbf97 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:24.745625 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:24.779717 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490af4b-8244-4338-93ff-f4d4e5c5f4d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04804cfc28b84d398ef06e8e113a755d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:24.780308 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490af4b-8244-4338-93ff-f4d4e5c5f4d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:24.780585 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490af4b-8244-4338-93ff-f4d4e5c5f4d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:24.780853 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490af4b-8244-4338-93ff-f4d4e5c5f4d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:24.782517 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-d490af4b-8244-4338-93ff-f4d4e5c5f4d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:24.888765 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490af4b-8244-4338-93ff-f4d4e5c5f4d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:24.890207 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490af4b-8244-4338-93ff-f4d4e5c5f4d9 service neutron] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:24.907674 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 557/1126] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:49:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:49:27.204929 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e21b85-734f-403d-8345-047fa3c64ceb None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:27.205469 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e21b85-734f-403d-8345-047fa3c64ceb None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:27.205469 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e21b85-734f-403d-8345-047fa3c64ceb None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:27.206909 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 570/1127] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 00:49:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:49:27.212289 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a950dbb-e025-4670-b01f-a7756c340cab None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:27.212672 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a950dbb-e025-4670-b01f-a7756c340cab None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:27.212829 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a950dbb-e025-4670-b01f-a7756c340cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:27.278532 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-4a950dbb-e025-4670-b01f-a7756c340cab None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:49:27.279744 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-4a950dbb-e025-4670-b01f-a7756c340cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:27.300135 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:27.376913 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 558/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 00:49:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:49:27.662793 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e21b85-734f-403d-8345-047fa3c64ceb None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:27.664373 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-b4e21b85-734f-403d-8345-047fa3c64ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:27.766799 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e21b85-734f-403d-8345-047fa3c64ceb None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:27.841036 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b098e6-31fe-4990-be72-46f9db188afc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04804cfc28b84d398ef06e8e113a755d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:27.841566 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b098e6-31fe-4990-be72-46f9db188afc service neutron] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:27.841842 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b098e6-31fe-4990-be72-46f9db188afc service neutron] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:27.842130 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b098e6-31fe-4990-be72-46f9db188afc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:27.843713 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-b3b098e6-31fe-4990-be72-46f9db188afc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:27.883375 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:27.954337 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b098e6-31fe-4990-be72-46f9db188afc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:27.955784 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b098e6-31fe-4990-be72-46f9db188afc service neutron] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:27.973863 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 571/1129] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:49:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:49:30.166334 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c1bd8-1b7a-4a20-a66c-25c601f4f852 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:30.166921 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c1bd8-1b7a-4a20-a66c-25c601f4f852 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:30.166921 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c1bd8-1b7a-4a20-a66c-25c601f4f852 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:30.168238 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 559/1130] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 00:49:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:49:30.173753 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459441da-0d8f-4106-a7dd-c7a99ee7a3b8 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:30.174199 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459441da-0d8f-4106-a7dd-c7a99ee7a3b8 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:30.174347 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459441da-0d8f-4106-a7dd-c7a99ee7a3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:30.240772 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-459441da-0d8f-4106-a7dd-c7a99ee7a3b8 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:49:30.241980 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-459441da-0d8f-4106-a7dd-c7a99ee7a3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:30.332028 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:30.338152 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 572/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 00:49:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:49:30.620422 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c1bd8-1b7a-4a20-a66c-25c601f4f852 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:30.621940 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-5a2c1bd8-1b7a-4a20-a66c-25c601f4f852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:30.723425 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c1bd8-1b7a-4a20-a66c-25c601f4f852 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:30.771667 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:30.795560 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2ee714-8342-4599-9c0d-195e6abdd645 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04804cfc28b84d398ef06e8e113a755d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:30.796149 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ee714-8342-4599-9c0d-195e6abdd645 service neutron] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:30.796423 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ee714-8342-4599-9c0d-195e6abdd645 service neutron] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:30.796691 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ee714-8342-4599-9c0d-195e6abdd645 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:30.798270 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-6e2ee714-8342-4599-9c0d-195e6abdd645 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:30.904136 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2ee714-8342-4599-9c0d-195e6abdd645 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:30.905571 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2ee714-8342-4599-9c0d-195e6abdd645 service neutron] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:30.923744 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 560/1132] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:49:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:49:33.120272 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5dc6c-4963-486f-92a3-49a5402a81ef None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:33.120836 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5dc6c-4963-486f-92a3-49a5402a81ef None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:33.120836 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5dc6c-4963-486f-92a3-49a5402a81ef None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:33.122204 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 573/1133] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 00:49:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:49:33.127428 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac50215-e8e1-4e16-ae1e-3dbea4f7f15d None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:33.127818 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac50215-e8e1-4e16-ae1e-3dbea4f7f15d None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:33.127973 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac50215-e8e1-4e16-ae1e-3dbea4f7f15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:33.192415 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-3ac50215-e8e1-4e16-ae1e-3dbea4f7f15d None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:49:33.193608 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-3ac50215-e8e1-4e16-ae1e-3dbea4f7f15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:33.226650 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:33.290142 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 561/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 00:49:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:49:33.571697 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e5dc6c-4963-486f-92a3-49a5402a81ef None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:33.573323 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-f0e5dc6c-4963-486f-92a3-49a5402a81ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:33.676261 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e5dc6c-4963-486f-92a3-49a5402a81ef None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:33.748909 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f35b3-7555-4551-bce5-8dff8dc45f40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04804cfc28b84d398ef06e8e113a755d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:33.749504 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f35b3-7555-4551-bce5-8dff8dc45f40 service neutron] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:33.749780 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f35b3-7555-4551-bce5-8dff8dc45f40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:33.750047 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f35b3-7555-4551-bce5-8dff8dc45f40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:33.752205 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-b65f35b3-7555-4551-bce5-8dff8dc45f40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:33.799088 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:33.858999 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65f35b3-7555-4551-bce5-8dff8dc45f40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:33.860901 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65f35b3-7555-4551-bce5-8dff8dc45f40 service neutron] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:33.880486 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 574/1135] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:49:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:49:36.068657 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f8b7d-4f36-422e-9ea3-719b35417c84 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:36.069201 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f8b7d-4f36-422e-9ea3-719b35417c84 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:36.069201 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f8b7d-4f36-422e-9ea3-719b35417c84 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:36.070554 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 562/1136] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 00:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:49:36.075790 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645cda9b-ce97-4184-aa15-20f9a7e3ff81 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:36.076202 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645cda9b-ce97-4184-aa15-20f9a7e3ff81 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:36.076323 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645cda9b-ce97-4184-aa15-20f9a7e3ff81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:36.141171 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-645cda9b-ce97-4184-aa15-20f9a7e3ff81 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:49:36.142416 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-645cda9b-ce97-4184-aa15-20f9a7e3ff81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:36.238627 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 575/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 00:49:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:49:36.525163 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f8b7d-4f36-422e-9ea3-719b35417c84 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:36.526718 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-6f4f8b7d-4f36-422e-9ea3-719b35417c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:36.629354 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f8b7d-4f36-422e-9ea3-719b35417c84 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:36.684514 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:36.703336 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d014e5-366f-4552-a2da-483b037d660f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04804cfc28b84d398ef06e8e113a755d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:36.703939 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d014e5-366f-4552-a2da-483b037d660f service neutron] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:36.704219 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d014e5-366f-4552-a2da-483b037d660f service neutron] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:36.704492 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d014e5-366f-4552-a2da-483b037d660f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:36.706636 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-80d014e5-366f-4552-a2da-483b037d660f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:36.815800 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d014e5-366f-4552-a2da-483b037d660f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:36.817161 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d014e5-366f-4552-a2da-483b037d660f service neutron] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:36.834746 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 563/1138] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:49:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:49:39.021753 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d19162-40f8-42fb-84d1-e7076889a9b4 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:39.022335 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d19162-40f8-42fb-84d1-e7076889a9b4 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:39.022335 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d19162-40f8-42fb-84d1-e7076889a9b4 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:39.023683 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 576/1139] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 00:49:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:49:39.028862 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9436c-bc76-4984-9abb-a52c745d58f1 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:39.029241 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9436c-bc76-4984-9abb-a52c745d58f1 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:39.029418 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9436c-bc76-4984-9abb-a52c745d58f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:39.094985 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-c4b9436c-bc76-4984-9abb-a52c745d58f1 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:49:39.096822 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-c4b9436c-bc76-4984-9abb-a52c745d58f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:39.134264 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:39.192587 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 564/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 00:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:49:39.478977 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d19162-40f8-42fb-84d1-e7076889a9b4 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:39.480511 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-f4d19162-40f8-42fb-84d1-e7076889a9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:39.484414 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:39.583708 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d19162-40f8-42fb-84d1-e7076889a9b4 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:39.655858 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07aa990-8e5f-413a-ad58-9051d7fe3929 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04804cfc28b84d398ef06e8e113a755d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:39.656459 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07aa990-8e5f-413a-ad58-9051d7fe3929 service neutron] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:39.656738 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07aa990-8e5f-413a-ad58-9051d7fe3929 service neutron] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:39.657007 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07aa990-8e5f-413a-ad58-9051d7fe3929 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:39.659199 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-b07aa990-8e5f-413a-ad58-9051d7fe3929 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:39.718190 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:39.768210 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07aa990-8e5f-413a-ad58-9051d7fe3929 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:39.769648 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07aa990-8e5f-413a-ad58-9051d7fe3929 service neutron] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:39.788191 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 577/1141] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:49:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:49:41.959551 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fae149-c71d-48a1-a537-ddcc9f0955eb None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:41.960082 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fae149-c71d-48a1-a537-ddcc9f0955eb None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:41.960082 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fae149-c71d-48a1-a537-ddcc9f0955eb None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:41.961410 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 565/1142] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 00:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:49:41.966726 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b48f0-bb66-436c-b41c-4f5acc90afe5 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:41.967181 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b48f0-bb66-436c-b41c-4f5acc90afe5 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:41.967303 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b48f0-bb66-436c-b41c-4f5acc90afe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:42.033337 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-449b48f0-bb66-436c-b41c-4f5acc90afe5 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:49:42.034585 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-449b48f0-bb66-436c-b41c-4f5acc90afe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:42.130692 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 578/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 00:49:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:49:42.415252 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fae149-c71d-48a1-a537-ddcc9f0955eb None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:42.416792 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-e3fae149-c71d-48a1-a537-ddcc9f0955eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:42.517460 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fae149-c71d-48a1-a537-ddcc9f0955eb None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:42.583244 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:42.590371 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2cb4ed-50b8-44dc-b521-936e6583f674 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04804cfc28b84d398ef06e8e113a755d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:42.590972 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2cb4ed-50b8-44dc-b521-936e6583f674 service neutron] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:42.591254 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2cb4ed-50b8-44dc-b521-936e6583f674 service neutron] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:42.591527 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2cb4ed-50b8-44dc-b521-936e6583f674 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:42.593139 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-3b2cb4ed-50b8-44dc-b521-936e6583f674 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:42.700542 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2cb4ed-50b8-44dc-b521-936e6583f674 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:42.701905 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2cb4ed-50b8-44dc-b521-936e6583f674 service neutron] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:42.720172 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 566/1144] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:49:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:49:44.871271 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ea787-76c3-4f6e-9615-c625731fe50d None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:44.871811 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ea787-76c3-4f6e-9615-c625731fe50d None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:44.871811 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ea787-76c3-4f6e-9615-c625731fe50d None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:44.873230 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 579/1145] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 00:49:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:49:44.878433 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2873428-adaf-4f19-b7cc-cf7cafdae0bd None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:44.878857 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2873428-adaf-4f19-b7cc-cf7cafdae0bd None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:44.878972 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2873428-adaf-4f19-b7cc-cf7cafdae0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:44.943932 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-c2873428-adaf-4f19-b7cc-cf7cafdae0bd None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:49:44.945063 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-c2873428-adaf-4f19-b7cc-cf7cafdae0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:44.995019 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:45.043925 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 567/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 00:49:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:49:45.325548 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ea787-76c3-4f6e-9615-c625731fe50d None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:49:45.327201 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-d36ea787-76c3-4f6e-9615-c625731fe50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:45.341314 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:45.429825 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ea787-76c3-4f6e-9615-c625731fe50d None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:49:45.501250 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee61957a-e02c-4ef0-8bd7-d24f65dcc2bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04804cfc28b84d398ef06e8e113a755d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:49:45.501779 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61957a-e02c-4ef0-8bd7-d24f65dcc2bd service neutron] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:49:45.502611 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61957a-e02c-4ef0-8bd7-d24f65dcc2bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:49:45.502880 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61957a-e02c-4ef0-8bd7-d24f65dcc2bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:49:45.504441 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-ee61957a-e02c-4ef0-8bd7-d24f65dcc2bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:49:45.571988 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:45.613341 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee61957a-e02c-4ef0-8bd7-d24f65dcc2bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:49:45.614827 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee61957a-e02c-4ef0-8bd7-d24f65dcc2bd service neutron] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:49:45.632957 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 580/1147] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:49:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:49:55.042418 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=22 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:49:55.630671 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=25 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:05.325093 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cad26e-466f-4155-96c8-42cdb4862b17 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:05.325633 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cad26e-466f-4155-96c8-42cdb4862b17 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:05.325762 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cad26e-466f-4155-96c8-42cdb4862b17 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:05.327089 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 568/1148] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:05.333039 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406dd22d-61da-4861-a541-62461aeaaee6 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:05.333456 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406dd22d-61da-4861-a541-62461aeaaee6 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:05.333590 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406dd22d-61da-4861-a541-62461aeaaee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:05.398847 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-406dd22d-61da-4861-a541-62461aeaaee6 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:05.400093 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-406dd22d-61da-4861-a541-62461aeaaee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:05.495169 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 581/1149] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:50:05.789384 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ba91f-7f59-4817-afb6-630592d56d91 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:05.789669 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ba91f-7f59-4817-afb6-630592d56d91 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:05.789939 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ba91f-7f59-4817-afb6-630592d56d91 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:05.791418 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 569/1150] 10.222.0.23 () {54 vars in 962 bytes} [Sun Oct 23 00:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:05.796184 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3e890-21d5-45a4-8714-6b8cb5b449a0 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:05.796469 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3e890-21d5-45a4-8714-6b8cb5b449a0 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:05.796742 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3e890-21d5-45a4-8714-6b8cb5b449a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:05.872696 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-a9d3e890-21d5-45a4-8714-6b8cb5b449a0 None None] MFA Rules not processed for user `1b94f1f12db3473f9ce1f33d2d9056a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:05.873895 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-a9d3e890-21d5-45a4-8714-6b8cb5b449a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:05.894619 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:05.949644 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 582/1151] 10.222.0.23 () {58 vars in 1059 bytes} [Sun Oct 23 00:50:05 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:50:05.957577 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ba91f-7f59-4817-afb6-630592d56d91 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:05.959151 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-4e7ba91f-7f59-4817-afb6-630592d56d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:06.060788 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ba91f-7f59-4817-afb6-630592d56d91 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:06.133939 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2bd18-4b8a-48e4-9b62-734ebe3facdf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b94f1f12db3473f9ce1f33d2d9056a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:06.134565 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2bd18-4b8a-48e4-9b62-734ebe3facdf service glance] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:06.134842 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2bd18-4b8a-48e4-9b62-734ebe3facdf service glance] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:06.135105 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2bd18-4b8a-48e4-9b62-734ebe3facdf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:06.136657 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-10f2bd18-4b8a-48e4-9b62-734ebe3facdf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:06.188418 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:06.243040 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f2bd18-4b8a-48e4-9b62-734ebe3facdf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:06.244411 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f2bd18-4b8a-48e4-9b62-734ebe3facdf service glance] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:06.262820 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 570/1152] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:50:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:50:08.511664 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05a0b4-0637-4a07-b38d-4632aad08c35 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:08.512209 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05a0b4-0637-4a07-b38d-4632aad08c35 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:08.512209 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05a0b4-0637-4a07-b38d-4632aad08c35 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:08.513491 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 583/1153] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:50:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:08.519343 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3bf17c-57f1-4dd8-a618-749a46937ef5 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:08.519741 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3bf17c-57f1-4dd8-a618-749a46937ef5 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:08.519895 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3bf17c-57f1-4dd8-a618-749a46937ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:08.584452 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-ed3bf17c-57f1-4dd8-a618-749a46937ef5 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:08.585653 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-ed3bf17c-57f1-4dd8-a618-749a46937ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:08.678971 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 571/1154] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:50:08.951198 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed05a0b4-0637-4a07-b38d-4632aad08c35 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:08.952721 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-ed05a0b4-0637-4a07-b38d-4632aad08c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:09.077390 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed05a0b4-0637-4a07-b38d-4632aad08c35 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:09.128418 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:09.172755 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137f2bb-1d56-4d54-a46a-c0b8eb404ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:09.173283 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137f2bb-1d56-4d54-a46a-c0b8eb404ccb admin admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:09.173562 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137f2bb-1d56-4d54-a46a-c0b8eb404ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:09.173830 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137f2bb-1d56-4d54-a46a-c0b8eb404ccb admin admin] PATH_INFO: `/v3/projects` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:09.174551 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2137f2bb-1d56-4d54-a46a-c0b8eb404ccb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:09.175654 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: WARNING py.warnings [None req-2137f2bb-1d56-4d54-a46a-c0b8eb404ccb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 00:50:09.175654 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: warnings.warn(msg) Oct 23 00:50:09.175654 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: Oct 23 00:50:09.176783 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2137f2bb-1d56-4d54-a46a-c0b8eb404ccb admin admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:09.196096 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 584/1155] 10.222.0.23 () {56 vars in 1108 bytes} [Sun Oct 23 00:50:08 2022] GET /identity/v3/projects => generated 2553 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:50:11.360051 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2170b-57f9-4f97-b76e-b8c6e7f54a56 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:11.360601 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2170b-57f9-4f97-b76e-b8c6e7f54a56 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:11.360698 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2170b-57f9-4f97-b76e-b8c6e7f54a56 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:11.362506 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 572/1156] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:50:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:11.367781 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5221ba2-0d15-40a1-b1b5-5c8e60404239 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:11.368165 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5221ba2-0d15-40a1-b1b5-5c8e60404239 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:11.368327 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5221ba2-0d15-40a1-b1b5-5c8e60404239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:11.433972 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-c5221ba2-0d15-40a1-b1b5-5c8e60404239 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:11.435199 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-c5221ba2-0d15-40a1-b1b5-5c8e60404239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:11.531279 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 585/1157] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:50:11.824972 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac2170b-57f9-4f97-b76e-b8c6e7f54a56 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:11.826676 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-0ac2170b-57f9-4f97-b76e-b8c6e7f54a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:11.837687 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:11.978608 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac2170b-57f9-4f97-b76e-b8c6e7f54a56 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:12.056084 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:12.089673 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21d280-1034-4307-b865-fc5b8f6a7dcd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90f691140a8341ada73a8c6f01ad798c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:12.090239 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21d280-1034-4307-b865-fc5b8f6a7dcd service nova] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:12.090519 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21d280-1034-4307-b865-fc5b8f6a7dcd service nova] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:12.090791 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21d280-1034-4307-b865-fc5b8f6a7dcd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:12.092406 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-2a21d280-1034-4307-b865-fc5b8f6a7dcd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:12.180282 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21d280-1034-4307-b865-fc5b8f6a7dcd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:12.181871 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21d280-1034-4307-b865-fc5b8f6a7dcd service nova] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:12.199686 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 573/1158] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:50:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:50:14.516591 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8822b-01f4-47b8-b92f-d21de64aa995 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:14.517117 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8822b-01f4-47b8-b92f-d21de64aa995 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:14.517117 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8822b-01f4-47b8-b92f-d21de64aa995 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:14.519257 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 586/1159] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:50:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:50:14.524525 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53110798-31d7-4a75-b874-cdae5315bd15 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:14.524963 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53110798-31d7-4a75-b874-cdae5315bd15 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:14.525089 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53110798-31d7-4a75-b874-cdae5315bd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:14.589942 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-53110798-31d7-4a75-b874-cdae5315bd15 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:14.591165 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-53110798-31d7-4a75-b874-cdae5315bd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:14.636063 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:14.685128 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 574/1160] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:50:14.972737 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b8822b-01f4-47b8-b92f-d21de64aa995 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:14.974299 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-28b8822b-01f4-47b8-b92f-d21de64aa995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:14.998356 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:15.076370 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b8822b-01f4-47b8-b92f-d21de64aa995 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:15.149872 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36555c01-9645-4a73-8a94-7958c2d30401 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04804cfc28b84d398ef06e8e113a755d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:15.150507 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36555c01-9645-4a73-8a94-7958c2d30401 service neutron] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:15.150782 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36555c01-9645-4a73-8a94-7958c2d30401 service neutron] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:15.151048 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36555c01-9645-4a73-8a94-7958c2d30401 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:15.152628 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-36555c01-9645-4a73-8a94-7958c2d30401 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:15.227488 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:15.262658 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36555c01-9645-4a73-8a94-7958c2d30401 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:15.264092 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36555c01-9645-4a73-8a94-7958c2d30401 service neutron] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:15.281443 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 587/1161] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:50:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:50:17.468503 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fac62-1cd2-4c1d-93c3-01146c7f05d8 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:17.469077 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fac62-1cd2-4c1d-93c3-01146c7f05d8 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:17.469077 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fac62-1cd2-4c1d-93c3-01146c7f05d8 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:17.470452 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 575/1162] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:17.476434 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3bbb7-bc08-491f-b97d-0595c309bffc None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:17.476892 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3bbb7-bc08-491f-b97d-0595c309bffc None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:17.476991 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3bbb7-bc08-491f-b97d-0595c309bffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:17.542658 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-d0d3bbb7-bc08-491f-b97d-0595c309bffc None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:17.543770 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-d0d3bbb7-bc08-491f-b97d-0595c309bffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:17.640305 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 588/1163] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:50:17.927017 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3fac62-1cd2-4c1d-93c3-01146c7f05d8 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:17.928609 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-0d3fac62-1cd2-4c1d-93c3-01146c7f05d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:18.032793 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3fac62-1cd2-4c1d-93c3-01146c7f05d8 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:18.103617 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:18.105176 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4fc15-4ab3-4f53-94bf-e051881e06b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04804cfc28b84d398ef06e8e113a755d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:18.105838 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4fc15-4ab3-4f53-94bf-e051881e06b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:18.106326 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4fc15-4ab3-4f53-94bf-e051881e06b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:18.106812 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4fc15-4ab3-4f53-94bf-e051881e06b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:18.108663 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-a4b4fc15-4ab3-4f53-94bf-e051881e06b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:18.218696 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b4fc15-4ab3-4f53-94bf-e051881e06b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:18.220054 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b4fc15-4ab3-4f53-94bf-e051881e06b8 service neutron] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:18.238611 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 576/1164] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:50:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:50:20.528179 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feadac1-c5db-44a7-9a58-1706b0802a86 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:20.528714 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feadac1-c5db-44a7-9a58-1706b0802a86 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:20.528714 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feadac1-c5db-44a7-9a58-1706b0802a86 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:20.529997 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 589/1165] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:50:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:20.535346 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5d5a5-9b48-42fa-ac80-f23163e97202 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:20.535754 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5d5a5-9b48-42fa-ac80-f23163e97202 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:20.535898 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5d5a5-9b48-42fa-ac80-f23163e97202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:20.601061 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-2ff5d5a5-9b48-42fa-ac80-f23163e97202 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:20.602281 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-2ff5d5a5-9b48-42fa-ac80-f23163e97202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:20.653714 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:20.696526 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 577/1166] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:50:20.989443 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feadac1-c5db-44a7-9a58-1706b0802a86 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:20.990996 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-4feadac1-c5db-44a7-9a58-1706b0802a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:21.027030 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:21.093847 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feadac1-c5db-44a7-9a58-1706b0802a86 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:21.169842 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469c1ad-f2e8-4562-ab26-20cc8e03084d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04804cfc28b84d398ef06e8e113a755d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:21.170479 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469c1ad-f2e8-4562-ab26-20cc8e03084d service neutron] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:21.170756 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469c1ad-f2e8-4562-ab26-20cc8e03084d service neutron] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:21.171024 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469c1ad-f2e8-4562-ab26-20cc8e03084d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:21.172774 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-b469c1ad-f2e8-4562-ab26-20cc8e03084d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:21.254177 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:21.284014 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b469c1ad-f2e8-4562-ab26-20cc8e03084d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:21.285463 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b469c1ad-f2e8-4562-ab26-20cc8e03084d service neutron] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:21.303344 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 590/1167] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:50:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:50:23.620528 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53de87-a2f2-4d4c-9495-3a75f9b24d64 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:23.621048 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53de87-a2f2-4d4c-9495-3a75f9b24d64 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:23.621157 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53de87-a2f2-4d4c-9495-3a75f9b24d64 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:23.622454 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 578/1168] 10.222.0.23 () {54 vars in 927 bytes} [Sun Oct 23 00:50:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:50:23.628288 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e591e-509f-443a-9b91-d707b5de4f7d None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:23.628692 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e591e-509f-443a-9b91-d707b5de4f7d None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:23.628862 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e591e-509f-443a-9b91-d707b5de4f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:23.694060 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-b67e591e-509f-443a-9b91-d707b5de4f7d None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:50:23.695281 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-b67e591e-509f-443a-9b91-d707b5de4f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:23.789028 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 591/1169] 10.222.0.23 () {58 vars in 1024 bytes} [Sun Oct 23 00:50:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:50:24.082806 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53de87-a2f2-4d4c-9495-3a75f9b24d64 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:50:24.084364 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-cf53de87-a2f2-4d4c-9495-3a75f9b24d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:24.186034 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53de87-a2f2-4d4c-9495-3a75f9b24d64 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:50:24.259626 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42b8ac-eafd-4130-b863-43c393e157cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04804cfc28b84d398ef06e8e113a755d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:50:24.260230 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42b8ac-eafd-4130-b863-43c393e157cb service neutron] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:50:24.260510 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42b8ac-eafd-4130-b863-43c393e157cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:50:24.260783 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42b8ac-eafd-4130-b863-43c393e157cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:50:24.262410 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-2d42b8ac-eafd-4130-b863-43c393e157cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:50:24.270951 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:24.371214 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d42b8ac-eafd-4130-b863-43c393e157cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:50:24.372658 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d42b8ac-eafd-4130-b863-43c393e157cb service neutron] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:50:24.390210 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 579/1170] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:50:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:50:33.787540 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=82 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:50:34.387916 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=50 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:43.167232 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29f894-30b4-43f1-b4c6-983cdcc76ee2 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:43.167826 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29f894-30b4-43f1-b4c6-983cdcc76ee2 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:43.167826 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29f894-30b4-43f1-b4c6-983cdcc76ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:43.248935 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-bd29f894-30b4-43f1-b4c6-983cdcc76ee2 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:43.250430 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-bd29f894-30b4-43f1-b4c6-983cdcc76ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:43.345673 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 592/1171] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 23 00:51:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:51:43.354364 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370f3f9-a0d6-4c8f-8a86-52258c17cad5 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:43.354888 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370f3f9-a0d6-4c8f-8a86-52258c17cad5 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:43.354988 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370f3f9-a0d6-4c8f-8a86-52258c17cad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:43.430256 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-e370f3f9-a0d6-4c8f-8a86-52258c17cad5 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:43.431387 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-e370f3f9-a0d6-4c8f-8a86-52258c17cad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:43.533344 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 580/1172] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 23 00:51:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:51:43.538917 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29f894-30b4-43f1-b4c6-983cdcc76ee2 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:43.540133 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-bd29f894-30b4-43f1-b4c6-983cdcc76ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:43.551520 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29f894-30b4-43f1-b4c6-983cdcc76ee2 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:43.614663 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:43.649935 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc603179-a367-42fc-9227-79b75ac15bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:43.650580 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc603179-a367-42fc-9227-79b75ac15bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:43.650889 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc603179-a367-42fc-9227-79b75ac15bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:43.651166 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc603179-a367-42fc-9227-79b75ac15bb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:43.651807 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc603179-a367-42fc-9227-79b75ac15bb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:51:43.652109 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc603179-a367-42fc-9227-79b75ac15bb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:43.653128 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: WARNING py.warnings [None req-bc603179-a367-42fc-9227-79b75ac15bb1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 00:51:43.653128 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: warnings.warn(msg) Oct 23 00:51:43.653128 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: Oct 23 00:51:43.654013 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc603179-a367-42fc-9227-79b75ac15bb1 admin admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:43.665586 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 593/1173] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 23 00:51:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:51:43.675091 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370f3f9-a0d6-4c8f-8a86-52258c17cad5 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:43.684317 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370f3f9-a0d6-4c8f-8a86-52258c17cad5 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:43.745366 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:43.780182 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92856260-e749-4868-98c7-435cbe8fda8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:43.780778 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92856260-e749-4868-98c7-435cbe8fda8b admin admin] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:43.781083 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92856260-e749-4868-98c7-435cbe8fda8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:43.781353 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92856260-e749-4868-98c7-435cbe8fda8b admin admin] PATH_INFO: `/v3/projects` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:43.781989 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92856260-e749-4868-98c7-435cbe8fda8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:43.783041 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: WARNING py.warnings [None req-92856260-e749-4868-98c7-435cbe8fda8b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 00:51:43.783041 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: warnings.warn(msg) Oct 23 00:51:43.783041 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: Oct 23 00:51:43.784271 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92856260-e749-4868-98c7-435cbe8fda8b admin admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:43.840556 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 581/1174] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 23 00:51:43 2022] POST /identity/v3/projects => generated 377 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:51:43.844770 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc603179-a367-42fc-9227-79b75ac15bb1 admin admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:43.846292 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-bc603179-a367-42fc-9227-79b75ac15bb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:43.881721 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc603179-a367-42fc-9227-79b75ac15bb1 admin admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:43.976812 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb6afb-9da5-47da-91f1-909d9e37bb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:43.977341 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb6afb-9da5-47da-91f1-909d9e37bb00 admin admin] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:43.977617 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb6afb-9da5-47da-91f1-909d9e37bb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:43.977887 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb6afb-9da5-47da-91f1-909d9e37bb00 admin admin] PATH_INFO: `/v3/users` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:43.978560 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cb6afb-9da5-47da-91f1-909d9e37bb00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:43.979577 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: WARNING py.warnings [None req-23cb6afb-9da5-47da-91f1-909d9e37bb00 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 00:51:43.979577 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: warnings.warn(msg) Oct 23 00:51:43.979577 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: Oct 23 00:51:43.980819 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cb6afb-9da5-47da-91f1-909d9e37bb00 admin admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:44.022757 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 594/1175] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 23 00:51:43 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:51:44.026727 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92856260-e749-4868-98c7-435cbe8fda8b admin admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:44.028205 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-92856260-e749-4868-98c7-435cbe8fda8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:44.088855 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92856260-e749-4868-98c7-435cbe8fda8b admin admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:44.169976 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:44.182255 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e20d0-4798-4e92-8403-678cd7253fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:44.182987 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e20d0-4798-4e92-8403-678cd7253fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:44.183272 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e20d0-4798-4e92-8403-678cd7253fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:44.183539 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e20d0-4798-4e92-8403-678cd7253fb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:44.184171 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e20d0-4798-4e92-8403-678cd7253fb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:44.185760 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e20d0-4798-4e92-8403-678cd7253fb2 admin admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:44.198208 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 582/1176] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 23 00:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:51:44.202126 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb6afb-9da5-47da-91f1-909d9e37bb00 admin admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:44.203620 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-23cb6afb-9da5-47da-91f1-909d9e37bb00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:44.214782 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb6afb-9da5-47da-91f1-909d9e37bb00 admin admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:44.240092 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:44.310245 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23ca31-97f9-40df-bb3c-48c008040bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:44.310852 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23ca31-97f9-40df-bb3c-48c008040bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:44.311135 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23ca31-97f9-40df-bb3c-48c008040bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:44.311405 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23ca31-97f9-40df-bb3c-48c008040bc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:44.312073 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc23ca31-97f9-40df-bb3c-48c008040bc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:44.313681 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc23ca31-97f9-40df-bb3c-48c008040bc1 admin admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:44.326436 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 595/1177] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 23 00:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:51:44.330553 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e20d0-4798-4e92-8403-678cd7253fb2 admin admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:44.332064 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-9c6e20d0-4798-4e92-8403-678cd7253fb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:44.365447 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e20d0-4798-4e92-8403-678cd7253fb2 admin admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:44.457606 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd1ca63-c578-42eb-81b1-e010cfd6c29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:44.458278 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1ca63-c578-42eb-81b1-e010cfd6c29f admin admin] REQUEST_METHOD: `PUT` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:44.458580 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1ca63-c578-42eb-81b1-e010cfd6c29f admin admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:44.458851 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1ca63-c578-42eb-81b1-e010cfd6c29f admin admin] PATH_INFO: `/v3/projects/b01812803204414eba1d354ec3308f1b/users/644011b89c844e89a14fffa307facb95/roles/130c11043623491c8f8e67ecb6f3efbc` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:44.481771 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd1ca63-c578-42eb-81b1-e010cfd6c29f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b01812803204414eba1d354ec3308f1b, user_id=644011b89c844e89a14fffa307facb95, role_id=130c11043623491c8f8e67ecb6f3efbc)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:44.484394 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd1ca63-c578-42eb-81b1-e010cfd6c29f admin admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:44.508113 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 583/1178] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 23 00:51:44 2022] PUT /identity/v3/projects/b01812803204414eba1d354ec3308f1b/users/644011b89c844e89a14fffa307facb95/roles/130c11043623491c8f8e67ecb6f3efbc => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:51:44.519813 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d0127-b9f7-4b53-9638-809b4b4efb02 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:44.520093 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d0127-b9f7-4b53-9638-809b4b4efb02 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:44.520363 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d0127-b9f7-4b53-9638-809b4b4efb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:44.576298 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-dc0d0127-b9f7-4b53-9638-809b4b4efb02 None None] MFA Rules not processed for user `644011b89c844e89a14fffa307facb95`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:44.577503 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-dc0d0127-b9f7-4b53-9638-809b4b4efb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:44.653792 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 596/1179] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 23 00:51:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:51:44.666742 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0c958-69ec-408f-901e-c1ebc9e85d36 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:44.667029 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0c958-69ec-408f-901e-c1ebc9e85d36 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:44.667301 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0c958-69ec-408f-901e-c1ebc9e85d36 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:44.668635 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 584/1180] 10.222.0.23 () {54 vars in 963 bytes} [Sun Oct 23 00:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:51:44.673487 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89289b10-66ab-432d-8cc3-f29ba9ab10d9 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:44.673770 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89289b10-66ab-432d-8cc3-f29ba9ab10d9 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:44.674040 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89289b10-66ab-432d-8cc3-f29ba9ab10d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:44.706477 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:44.750902 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-89289b10-66ab-432d-8cc3-f29ba9ab10d9 None None] MFA Rules not processed for user `57aa88f06f88438c8f0d4d2e65be71c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:44.752044 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-89289b10-66ab-432d-8cc3-f29ba9ab10d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:44.827002 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 597/1181] 10.222.0.23 () {58 vars in 1060 bytes} [Sun Oct 23 00:51:44 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:51:44.834667 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0c958-69ec-408f-901e-c1ebc9e85d36 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:44.836160 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-75a0c958-69ec-408f-901e-c1ebc9e85d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:44.885423 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:44.940403 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0c958-69ec-408f-901e-c1ebc9e85d36 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:45.014787 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab743a-d1cc-4be0-bbe9-915717fb31ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57aa88f06f88438c8f0d4d2e65be71c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:45.015316 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab743a-d1cc-4be0-bbe9-915717fb31ca service cinder] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:45.015593 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab743a-d1cc-4be0-bbe9-915717fb31ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:45.015861 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab743a-d1cc-4be0-bbe9-915717fb31ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:45.017442 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-d4ab743a-d1cc-4be0-bbe9-915717fb31ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:45.116225 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab743a-d1cc-4be0-bbe9-915717fb31ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:45.117667 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab743a-d1cc-4be0-bbe9-915717fb31ca service cinder] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:45.121133 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:45.135835 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 585/1182] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:51:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:51:45.180807 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd848c7-3718-48e2-a7ca-3ce6c5590cb7 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:45.181123 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd848c7-3718-48e2-a7ca-3ce6c5590cb7 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:45.181404 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd848c7-3718-48e2-a7ca-3ce6c5590cb7 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:45.182721 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 598/1183] 10.222.0.23 () {52 vars in 830 bytes} [Sun Oct 23 00:51:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:51:45.186393 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab743a-d1cc-4be0-bbe9-915717fb31ca service cinder] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:45.187590 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-d4ab743a-d1cc-4be0-bbe9-915717fb31ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:45.285514 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab743a-d1cc-4be0-bbe9-915717fb31ca service cinder] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:45.376290 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d0878-67fb-4811-84c7-6d3153470b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:45.376920 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d0878-67fb-4811-84c7-6d3153470b78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:45.377171 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d0878-67fb-4811-84c7-6d3153470b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:45.377438 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d0878-67fb-4811-84c7-6d3153470b78 admin admin] PATH_INFO: `/v3/users/644011b89c844e89a14fffa307facb95` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:45.390427 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3d0878-67fb-4811-84c7-6d3153470b78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=644011b89c844e89a14fffa307facb95)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:45.391449 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: WARNING py.warnings [None req-7c3d0878-67fb-4811-84c7-6d3153470b78 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 00:51:45.391449 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: warnings.warn(msg) Oct 23 00:51:45.391449 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: Oct 23 00:51:45.392653 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3d0878-67fb-4811-84c7-6d3153470b78 admin admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:45.402651 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:45.458371 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [None req-7c3d0878-67fb-4811-84c7-6d3153470b78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '644011b89c844e89a14fffa307facb95'} {{(pid=81358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:51:45.475793 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [None req-7c3d0878-67fb-4811-84c7-6d3153470b78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '644011b89c844e89a14fffa307facb95'} {{(pid=81358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:51:45.476283 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [None req-7c3d0878-67fb-4811-84c7-6d3153470b78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '644011b89c844e89a14fffa307facb95'} {{(pid=81358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:51:45.485578 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [None req-7c3d0878-67fb-4811-84c7-6d3153470b78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '644011b89c844e89a14fffa307facb95'} {{(pid=81358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:51:45.508438 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [None req-7c3d0878-67fb-4811-84c7-6d3153470b78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '644011b89c844e89a14fffa307facb95'} {{(pid=81358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:51:45.514411 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 586/1184] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 23 00:51:45 2022] DELETE /identity/v3/users/644011b89c844e89a14fffa307facb95 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:51:45.518907 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216ea3d-a653-468a-8132-cbcc32ab8af8 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:45.519397 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216ea3d-a653-468a-8132-cbcc32ab8af8 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:45.519512 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216ea3d-a653-468a-8132-cbcc32ab8af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:45.576423 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-f216ea3d-a653-468a-8132-cbcc32ab8af8 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:51:45.577555 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-f216ea3d-a653-468a-8132-cbcc32ab8af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:45.652581 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:45.665587 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 599/1185] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 23 00:51:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:51:45.675384 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d0878-67fb-4811-84c7-6d3153470b78 admin admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:45.676604 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-7c3d0878-67fb-4811-84c7-6d3153470b78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:45.776186 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d0878-67fb-4811-84c7-6d3153470b78 admin admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:45.829501 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:45.851432 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b28f3-4149-4e10-887d-0909c8ef4248 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04804cfc28b84d398ef06e8e113a755d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:45.852042 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b28f3-4149-4e10-887d-0909c8ef4248 service neutron] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:45.852319 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b28f3-4149-4e10-887d-0909c8ef4248 service neutron] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:45.852588 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b28f3-4149-4e10-887d-0909c8ef4248 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:45.854210 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-0c9b28f3-4149-4e10-887d-0909c8ef4248 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:45.961201 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9b28f3-4149-4e10-887d-0909c8ef4248 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:45.962685 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9b28f3-4149-4e10-887d-0909c8ef4248 service neutron] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:45.981913 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 587/1186] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:51:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:51:46.418518 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216ea3d-a653-468a-8132-cbcc32ab8af8 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:51:46.419745 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-f216ea3d-a653-468a-8132-cbcc32ab8af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:51:46.431058 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216ea3d-a653-468a-8132-cbcc32ab8af8 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:51:46.528301 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e6504-1285-443c-a57a-27543704724c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:51:46.528942 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e6504-1285-443c-a57a-27543704724c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:51:46.529246 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e6504-1285-443c-a57a-27543704724c admin admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:51:46.529543 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e6504-1285-443c-a57a-27543704724c admin admin] PATH_INFO: `/v3/projects/b01812803204414eba1d354ec3308f1b` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:51:46.540230 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e6504-1285-443c-a57a-27543704724c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b01812803204414eba1d354ec3308f1b)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:51:46.541297 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: WARNING py.warnings [None req-106e6504-1285-443c-a57a-27543704724c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 00:51:46.541297 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: warnings.warn(msg) Oct 23 00:51:46.541297 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: Oct 23 00:51:46.542539 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e6504-1285-443c-a57a-27543704724c admin admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:51:46.600382 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [None req-106e6504-1285-443c-a57a-27543704724c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b01812803204414eba1d354ec3308f1b', 'request_id': 'req-106e6504-1285-443c-a57a-27543704724c'} {{(pid=81359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:51:46.610738 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [None req-106e6504-1285-443c-a57a-27543704724c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b01812803204414eba1d354ec3308f1b', 'request_id': 'req-106e6504-1285-443c-a57a-27543704724c'} {{(pid=81359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:51:46.616949 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [None req-106e6504-1285-443c-a57a-27543704724c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b01812803204414eba1d354ec3308f1b', 'request_id': 'req-106e6504-1285-443c-a57a-27543704724c'} {{(pid=81359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:51:46.647493 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [None req-106e6504-1285-443c-a57a-27543704724c admin admin] The token cache is being invalidate because project b01812803204414eba1d354ec3308f1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 00:51:46.647778 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [None req-106e6504-1285-443c-a57a-27543704724c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:51:46.648303 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [None req-106e6504-1285-443c-a57a-27543704724c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 00:51:46.649586 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 600/1187] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 23 00:51:46 2022] DELETE /identity/v3/projects/b01812803204414eba1d354ec3308f1b => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:51:55.979712 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=62 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:51:56.645445 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:52:59.374168 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a081171-de51-4180-906a-b32686c66b72 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:52:59.374754 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a081171-de51-4180-906a-b32686c66b72 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:52:59.374754 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a081171-de51-4180-906a-b32686c66b72 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:52:59.376060 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 588/1188] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 00:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:52:59.381476 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920403a8-0bfe-45c8-ae70-db04c9e71e7c None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:52:59.381916 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920403a8-0bfe-45c8-ae70-db04c9e71e7c None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:52:59.382028 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920403a8-0bfe-45c8-ae70-db04c9e71e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:52:59.462220 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-920403a8-0bfe-45c8-ae70-db04c9e71e7c None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:52:59.463417 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-920403a8-0bfe-45c8-ae70-db04c9e71e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:52:59.564441 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 601/1189] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 00:52:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:52:59.719463 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a081171-de51-4180-906a-b32686c66b72 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:52:59.721721 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-1a081171-de51-4180-906a-b32686c66b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:52:59.842518 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a081171-de51-4180-906a-b32686c66b72 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:52:59.847923 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d6873-f9d2-4b47-af62-327eba6f5eba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90f691140a8341ada73a8c6f01ad798c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:52:59.848523 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d6873-f9d2-4b47-af62-327eba6f5eba service nova] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:52:59.848829 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d6873-f9d2-4b47-af62-327eba6f5eba service nova] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:52:59.849101 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d6873-f9d2-4b47-af62-327eba6f5eba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:52:59.857243 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d6873-f9d2-4b47-af62-327eba6f5eba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:52:59.858883 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d6873-f9d2-4b47-af62-327eba6f5eba service nova] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:52:59.868114 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 589/1190] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:52:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:53:00.919475 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f927f1-d1ff-4842-ab4f-78b21631f020 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:00.920045 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f927f1-d1ff-4842-ab4f-78b21631f020 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:00.920045 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f927f1-d1ff-4842-ab4f-78b21631f020 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:00.921360 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 602/1191] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 00:53:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:53:00.926121 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd6f7f-8847-4baf-b3d0-93e8a3c20baa None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:00.926585 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd6f7f-8847-4baf-b3d0-93e8a3c20baa None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:00.926690 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd6f7f-8847-4baf-b3d0-93e8a3c20baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:00.947126 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-bacd6f7f-8847-4baf-b3d0-93e8a3c20baa None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:53:00.948336 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-bacd6f7f-8847-4baf-b3d0-93e8a3c20baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:53:00.956111 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 590/1192] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 00:53:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:53:01.107216 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f927f1-d1ff-4842-ab4f-78b21631f020 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:01.122055 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f927f1-d1ff-4842-ab4f-78b21631f020 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:01.127471 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a3257e-7ebe-4bb6-836c-41e4f95b3107 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90f691140a8341ada73a8c6f01ad798c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:01.128067 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3257e-7ebe-4bb6-836c-41e4f95b3107 service nova] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:01.128348 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3257e-7ebe-4bb6-836c-41e4f95b3107 service nova] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:01.128624 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3257e-7ebe-4bb6-836c-41e4f95b3107 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:01.137248 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a3257e-7ebe-4bb6-836c-41e4f95b3107 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:01.138902 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a3257e-7ebe-4bb6-836c-41e4f95b3107 service nova] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:01.148382 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 603/1193] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:53:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:53:03.422369 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbe923-660f-49c0-a392-1d4e707666c6 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:03.422898 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbe923-660f-49c0-a392-1d4e707666c6 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:03.422898 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbe923-660f-49c0-a392-1d4e707666c6 None None] PATH_INFO: `/v3` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:03.424170 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 591/1194] 10.222.0.49 () {54 vars in 925 bytes} [Sun Oct 23 00:53:03 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 23 00:53:03.432565 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b08a41-1025-4fd5-ad0e-c0aaf5170cec None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:03.433005 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b08a41-1025-4fd5-ad0e-c0aaf5170cec None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:03.433100 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b08a41-1025-4fd5-ad0e-c0aaf5170cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:03.493182 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-e7b08a41-1025-4fd5-ad0e-c0aaf5170cec None None] MFA Rules not processed for user `1863d19ad4624ea496c2c73b70ae0c6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:53:03.494352 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-e7b08a41-1025-4fd5-ad0e-c0aaf5170cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:53:03.511760 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:53:03.566642 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 604/1195] 10.222.0.49 () {58 vars in 1015 bytes} [Sun Oct 23 00:53:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:53:10.941627 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=56 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:53:12.188364 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7612e5-45a0-43a1-9e36-79d8c63ee275 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:12.188982 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7612e5-45a0-43a1-9e36-79d8c63ee275 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:12.188982 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7612e5-45a0-43a1-9e36-79d8c63ee275 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:12.190793 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 592/1196] 10.222.0.23 () {54 vars in 961 bytes} [Sun Oct 23 00:53:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:53:12.195504 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a3653-ba13-44c1-bcbe-ebd1079c9e53 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:12.195950 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a3653-ba13-44c1-bcbe-ebd1079c9e53 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:12.196055 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a3653-ba13-44c1-bcbe-ebd1079c9e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:12.216150 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-9d0a3653-ba13-44c1-bcbe-ebd1079c9e53 None None] MFA Rules not processed for user `1863d19ad4624ea496c2c73b70ae0c6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:53:12.217345 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-9d0a3653-ba13-44c1-bcbe-ebd1079c9e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:53:12.230528 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 605/1197] 10.222.0.23 () {58 vars in 1058 bytes} [Sun Oct 23 00:53:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:53:12.238008 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7612e5-45a0-43a1-9e36-79d8c63ee275 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:12.252365 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7612e5-45a0-43a1-9e36-79d8c63ee275 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:12.258774 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ebc02-d693-4dc5-9517-160a3b99bf86 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1863d19ad4624ea496c2c73b70ae0c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:12.259407 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ebc02-d693-4dc5-9517-160a3b99bf86 service placement] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:12.259685 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ebc02-d693-4dc5-9517-160a3b99bf86 service placement] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:12.259953 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ebc02-d693-4dc5-9517-160a3b99bf86 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:12.268717 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ebc02-d693-4dc5-9517-160a3b99bf86 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:12.270342 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ebc02-d693-4dc5-9517-160a3b99bf86 service placement] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:12.280124 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 593/1198] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:53:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:53:12.615689 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015925f4-7fcc-4524-a33c-8111e804e82e None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:12.615919 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015925f4-7fcc-4524-a33c-8111e804e82e None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:12.616148 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015925f4-7fcc-4524-a33c-8111e804e82e None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:12.617515 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 606/1199] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 00:53:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:53:12.622959 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45fba5d-c7e9-470f-954d-356cd7d41a7e None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:12.623245 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45fba5d-c7e9-470f-954d-356cd7d41a7e None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:12.623545 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45fba5d-c7e9-470f-954d-356cd7d41a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:12.642855 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-f45fba5d-c7e9-470f-954d-356cd7d41a7e None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:53:12.644058 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-f45fba5d-c7e9-470f-954d-356cd7d41a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:53:12.651926 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 594/1200] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 00:53:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:53:12.808409 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015925f4-7fcc-4524-a33c-8111e804e82e None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:12.835225 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015925f4-7fcc-4524-a33c-8111e804e82e None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:12.840857 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7cbf78-6483-4ffa-afdb-21a3eaf5abcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90f691140a8341ada73a8c6f01ad798c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:12.841456 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cbf78-6483-4ffa-afdb-21a3eaf5abcb service nova] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:12.841738 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cbf78-6483-4ffa-afdb-21a3eaf5abcb service nova] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:12.842012 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cbf78-6483-4ffa-afdb-21a3eaf5abcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:12.850969 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7cbf78-6483-4ffa-afdb-21a3eaf5abcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:12.852554 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7cbf78-6483-4ffa-afdb-21a3eaf5abcb service nova] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:12.862031 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 607/1201] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:53:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:53:13.913990 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0335b-16a6-4cc1-b74e-8e8b1d5c3afa None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:13.914568 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0335b-16a6-4cc1-b74e-8e8b1d5c3afa None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:13.914568 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0335b-16a6-4cc1-b74e-8e8b1d5c3afa None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:13.915916 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 595/1202] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 23 00:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:53:13.920602 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fadf350-9e20-4b71-a99f-88d7d5fc5bdc None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:13.921029 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fadf350-9e20-4b71-a99f-88d7d5fc5bdc None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:13.921174 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fadf350-9e20-4b71-a99f-88d7d5fc5bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:13.940694 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-2fadf350-9e20-4b71-a99f-88d7d5fc5bdc None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:53:13.942183 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-2fadf350-9e20-4b71-a99f-88d7d5fc5bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:53:13.950394 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 608/1203] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 23 00:53:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:53:14.100676 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f0335b-16a6-4cc1-b74e-8e8b1d5c3afa None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:14.115548 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f0335b-16a6-4cc1-b74e-8e8b1d5c3afa None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:14.120909 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9fe019-196a-442e-92b2-0802c21c942a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90f691140a8341ada73a8c6f01ad798c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:14.121498 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fe019-196a-442e-92b2-0802c21c942a service nova] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:14.121775 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fe019-196a-442e-92b2-0802c21c942a service nova] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:14.122045 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fe019-196a-442e-92b2-0802c21c942a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:14.130046 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9fe019-196a-442e-92b2-0802c21c942a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:14.131758 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9fe019-196a-442e-92b2-0802c21c942a service nova] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:14.141332 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 596/1204] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:53:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:53:18.166171 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46073e84-6aee-483d-a77a-2b0e26713171 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:18.166731 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46073e84-6aee-483d-a77a-2b0e26713171 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:18.166731 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46073e84-6aee-483d-a77a-2b0e26713171 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:18.168087 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 609/1205] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 00:53:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:53:18.173361 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67346e67-44b3-4c55-91a5-21ce370eb1ff None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:18.173772 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67346e67-44b3-4c55-91a5-21ce370eb1ff None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:18.173912 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67346e67-44b3-4c55-91a5-21ce370eb1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:18.193016 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-67346e67-44b3-4c55-91a5-21ce370eb1ff None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:53:18.194203 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-67346e67-44b3-4c55-91a5-21ce370eb1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:53:18.201912 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 597/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 00:53:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:53:18.492441 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46073e84-6aee-483d-a77a-2b0e26713171 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:18.494234 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-46073e84-6aee-483d-a77a-2b0e26713171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:53:18.571391 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46073e84-6aee-483d-a77a-2b0e26713171 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:18.574933 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199da601-6981-47fb-86d4-d83ca9ac1117 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04804cfc28b84d398ef06e8e113a755d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:18.575520 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199da601-6981-47fb-86d4-d83ca9ac1117 service neutron] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:18.575794 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199da601-6981-47fb-86d4-d83ca9ac1117 service neutron] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:18.576059 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199da601-6981-47fb-86d4-d83ca9ac1117 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:18.585306 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199da601-6981-47fb-86d4-d83ca9ac1117 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:18.586757 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199da601-6981-47fb-86d4-d83ca9ac1117 service neutron] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:18.595893 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 610/1207] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:53:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:53:20.746984 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bcf627-b3ab-4cdb-84fa-2afbbe487ff1 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:20.747550 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bcf627-b3ab-4cdb-84fa-2afbbe487ff1 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:20.747550 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bcf627-b3ab-4cdb-84fa-2afbbe487ff1 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:20.748930 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 598/1208] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 00:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:53:20.754294 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0061b39-86a2-478d-82fd-b664dbfe1593 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:20.754714 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0061b39-86a2-478d-82fd-b664dbfe1593 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:20.754827 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0061b39-86a2-478d-82fd-b664dbfe1593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:20.775445 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-b0061b39-86a2-478d-82fd-b664dbfe1593 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:53:20.776638 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-b0061b39-86a2-478d-82fd-b664dbfe1593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:53:20.784295 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 611/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 00:53:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:53:21.070090 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bcf627-b3ab-4cdb-84fa-2afbbe487ff1 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:21.080938 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bcf627-b3ab-4cdb-84fa-2afbbe487ff1 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:21.084577 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84753be0-48b3-468c-b723-6bb7667482de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04804cfc28b84d398ef06e8e113a755d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:21.085175 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84753be0-48b3-468c-b723-6bb7667482de service neutron] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:21.085457 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84753be0-48b3-468c-b723-6bb7667482de service neutron] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:21.085728 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84753be0-48b3-468c-b723-6bb7667482de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:21.094518 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84753be0-48b3-468c-b723-6bb7667482de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:21.095956 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84753be0-48b3-468c-b723-6bb7667482de service neutron] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:21.106012 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 599/1210] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:53:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:53:24.942582 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfd5b2-8578-4713-99d6-d2f223b951ef None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:24.943185 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfd5b2-8578-4713-99d6-d2f223b951ef None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:24.943185 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfd5b2-8578-4713-99d6-d2f223b951ef None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:24.944489 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 612/1211] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 00:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:53:24.949658 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5ea81-0281-4aa3-bf92-e9bd516ae0a0 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:24.950128 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5ea81-0281-4aa3-bf92-e9bd516ae0a0 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:24.950232 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5ea81-0281-4aa3-bf92-e9bd516ae0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:24.970438 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-46e5ea81-0281-4aa3-bf92-e9bd516ae0a0 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:53:24.971627 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-46e5ea81-0281-4aa3-bf92-e9bd516ae0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:53:24.980599 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 600/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 00:53:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:53:25.284735 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dfd5b2-8578-4713-99d6-d2f223b951ef None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:25.286966 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-77dfd5b2-8578-4713-99d6-d2f223b951ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:53:25.351640 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:53:25.365138 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dfd5b2-8578-4713-99d6-d2f223b951ef None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:25.368753 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b7ac2-b150-4efa-8ff2-2a20e9345c8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57aa88f06f88438c8f0d4d2e65be71c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:25.369354 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b7ac2-b150-4efa-8ff2-2a20e9345c8c service cinder] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:25.369634 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b7ac2-b150-4efa-8ff2-2a20e9345c8c service cinder] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:25.369906 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b7ac2-b150-4efa-8ff2-2a20e9345c8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:25.378706 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8b7ac2-b150-4efa-8ff2-2a20e9345c8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:25.380669 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8b7ac2-b150-4efa-8ff2-2a20e9345c8c service cinder] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:25.389970 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 613/1213] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:53:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:53:27.526353 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c09ec-d706-4622-bc94-4a6addb74966 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:27.526864 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c09ec-d706-4622-bc94-4a6addb74966 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:27.526864 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c09ec-d706-4622-bc94-4a6addb74966 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:27.528163 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 601/1214] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 23 00:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:53:27.533508 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64cecb-cd87-496e-a74c-a28c40dc3b4c None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:27.533977 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64cecb-cd87-496e-a74c-a28c40dc3b4c None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:27.534153 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64cecb-cd87-496e-a74c-a28c40dc3b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:27.553412 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-6a64cecb-cd87-496e-a74c-a28c40dc3b4c None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:53:27.554659 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-6a64cecb-cd87-496e-a74c-a28c40dc3b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:53:27.562469 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 614/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 23 00:53:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:53:27.863315 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c09ec-d706-4622-bc94-4a6addb74966 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:53:27.865009 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-e74c09ec-d706-4622-bc94-4a6addb74966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:53:27.877992 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c09ec-d706-4622-bc94-4a6addb74966 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:53:27.882322 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e026613-cf45-4c65-a031-07ff62d56a18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57aa88f06f88438c8f0d4d2e65be71c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:53:27.883035 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e026613-cf45-4c65-a031-07ff62d56a18 service cinder] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:53:27.883316 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e026613-cf45-4c65-a031-07ff62d56a18 service cinder] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:53:27.883586 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e026613-cf45-4c65-a031-07ff62d56a18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:53:27.892554 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e026613-cf45-4c65-a031-07ff62d56a18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:53:27.893987 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e026613-cf45-4c65-a031-07ff62d56a18 service cinder] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:53:27.904032 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 602/1216] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:53:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:53:37.548520 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=11 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:53:37.899916 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=33 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:54:44.807283 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3707f-375e-421d-8e63-25dc13364ada None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:44.807903 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3707f-375e-421d-8e63-25dc13364ada None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:44.807903 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3707f-375e-421d-8e63-25dc13364ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:44.812068 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0f67b-9cf6-4e17-85d9-3ed383fc6a92 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:44.812527 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0f67b-9cf6-4e17-85d9-3ed383fc6a92 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:44.812630 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0f67b-9cf6-4e17-85d9-3ed383fc6a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:44.827922 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-bbe3707f-375e-421d-8e63-25dc13364ada None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:54:44.829117 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-bbe3707f-375e-421d-8e63-25dc13364ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:54:44.833897 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-02e0f67b-9cf6-4e17-85d9-3ed383fc6a92 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:54:44.835106 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-02e0f67b-9cf6-4e17-85d9-3ed383fc6a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:54:44.837630 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 615/1217] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 23 00:54:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:54:44.843913 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 603/1218] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 23 00:54:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:54:44.846433 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d25a3b-b479-43cd-9329-dc9030f42f46 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:44.846721 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d25a3b-b479-43cd-9329-dc9030f42f46 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:44.847531 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d25a3b-b479-43cd-9329-dc9030f42f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:44.852818 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac969522-b0e5-4c67-a8b1-cc8343b5841e None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:44.853110 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac969522-b0e5-4c67-a8b1-cc8343b5841e None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:44.853381 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac969522-b0e5-4c67-a8b1-cc8343b5841e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:44.867239 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-22d25a3b-b479-43cd-9329-dc9030f42f46 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:54:44.868426 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-22d25a3b-b479-43cd-9329-dc9030f42f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:54:44.872785 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-ac969522-b0e5-4c67-a8b1-cc8343b5841e None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:54:44.873955 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-ac969522-b0e5-4c67-a8b1-cc8343b5841e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:54:44.876156 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 616/1219] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 23 00:54:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:54:44.880541 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d25a3b-b479-43cd-9329-dc9030f42f46 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:54:44.881715 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 604/1220] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 23 00:54:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:54:44.886062 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac969522-b0e5-4c67-a8b1-cc8343b5841e None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:54:44.890258 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d25a3b-b479-43cd-9329-dc9030f42f46 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:54:44.894839 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b38be0-7a74-4f9b-9d2b-8de04afa6d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:54:44.895009 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac969522-b0e5-4c67-a8b1-cc8343b5841e None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:54:44.895430 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b38be0-7a74-4f9b-9d2b-8de04afa6d34 admin admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:44.895718 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b38be0-7a74-4f9b-9d2b-8de04afa6d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:44.895983 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b38be0-7a74-4f9b-9d2b-8de04afa6d34 admin admin] PATH_INFO: `/v3/domains` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:44.896610 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b38be0-7a74-4f9b-9d2b-8de04afa6d34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81359) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:54:44.896907 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b38be0-7a74-4f9b-9d2b-8de04afa6d34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:54:44.898575 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b38be0-7a74-4f9b-9d2b-8de04afa6d34 admin admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:54:44.899742 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50552dd-c3af-46a1-814e-b3b5f414155a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:54:44.900328 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50552dd-c3af-46a1-814e-b3b5f414155a admin admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:44.900608 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50552dd-c3af-46a1-814e-b3b5f414155a admin admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:44.900884 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50552dd-c3af-46a1-814e-b3b5f414155a admin admin] PATH_INFO: `/v3/domains` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:44.901517 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50552dd-c3af-46a1-814e-b3b5f414155a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 23 00:54:44.901818 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50552dd-c3af-46a1-814e-b3b5f414155a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:54:44.902916 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: WARNING py.warnings [None req-e50552dd-c3af-46a1-814e-b3b5f414155a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 23 00:54:44.902916 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: warnings.warn(msg) Oct 23 00:54:44.902916 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: Oct 23 00:54:44.903782 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50552dd-c3af-46a1-814e-b3b5f414155a admin admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:54:44.911611 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 617/1221] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 23 00:54:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:54:44.918582 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 605/1222] 10.222.0.23 () {58 vars in 1153 bytes} [Sun Oct 23 00:54:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 23 00:54:44.919443 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b38be0-7a74-4f9b-9d2b-8de04afa6d34 admin admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:54:44.924473 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50552dd-c3af-46a1-814e-b3b5f414155a admin admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:54:44.930196 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b38be0-7a74-4f9b-9d2b-8de04afa6d34 admin admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:54:44.934626 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50552dd-c3af-46a1-814e-b3b5f414155a admin admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:54:44.934840 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c9d96-404b-43a9-80c4-2bc3dc4b81d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:54:44.935425 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c9d96-404b-43a9-80c4-2bc3dc4b81d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:44.935708 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c9d96-404b-43a9-80c4-2bc3dc4b81d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:44.935983 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c9d96-404b-43a9-80c4-2bc3dc4b81d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:44.936606 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c9d96-404b-43a9-80c4-2bc3dc4b81d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:54:44.937612 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: WARNING py.warnings [None req-231c9d96-404b-43a9-80c4-2bc3dc4b81d6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 00:54:44.937612 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: warnings.warn(msg) Oct 23 00:54:44.937612 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: Oct 23 00:54:44.938826 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c9d96-404b-43a9-80c4-2bc3dc4b81d6 admin admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:54:44.939534 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c621c86-3b27-44ec-a596-5d77793441c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:54:44.940109 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c621c86-3b27-44ec-a596-5d77793441c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:44.940386 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c621c86-3b27-44ec-a596-5d77793441c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:44.940685 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c621c86-3b27-44ec-a596-5d77793441c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:44.941330 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c621c86-3b27-44ec-a596-5d77793441c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:54:44.943246 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c621c86-3b27-44ec-a596-5d77793441c5 admin admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:54:44.981900 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 618/1223] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 23 00:54:44 2022] POST /identity/v3/projects => generated 377 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:54:44.982925 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c9d96-404b-43a9-80c4-2bc3dc4b81d6 admin admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:54:44.987332 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 606/1224] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 23 00:54:44 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:54:44.988824 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c621c86-3b27-44ec-a596-5d77793441c5 admin admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:54:45.044433 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c9d96-404b-43a9-80c4-2bc3dc4b81d6 admin admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:54:45.048792 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c621c86-3b27-44ec-a596-5d77793441c5 admin admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:54:45.049336 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f036a-3d7f-4d67-ac89-0f19d3960127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:54:45.049991 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f036a-3d7f-4d67-ac89-0f19d3960127 admin admin] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:45.051398 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f036a-3d7f-4d67-ac89-0f19d3960127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:45.051703 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f036a-3d7f-4d67-ac89-0f19d3960127 admin admin] PATH_INFO: `/v3/users` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:45.052341 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f036a-3d7f-4d67-ac89-0f19d3960127 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:54:45.054201 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab3301-4f66-4619-84ec-e4803c9dca52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:54:45.054345 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f036a-3d7f-4d67-ac89-0f19d3960127 admin admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:54:45.054794 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab3301-4f66-4619-84ec-e4803c9dca52 admin admin] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:45.055072 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab3301-4f66-4619-84ec-e4803c9dca52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:45.055341 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab3301-4f66-4619-84ec-e4803c9dca52 admin admin] PATH_INFO: `/v3/users` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:45.056028 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab3301-4f66-4619-84ec-e4803c9dca52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:54:45.057020 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: WARNING py.warnings [None req-a7ab3301-4f66-4619-84ec-e4803c9dca52 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 23 00:54:45.057020 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: warnings.warn(msg) Oct 23 00:54:45.057020 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: Oct 23 00:54:45.058320 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab3301-4f66-4619-84ec-e4803c9dca52 admin admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:54:45.079577 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 619/1225] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 23 00:54:44 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:54:45.080552 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f036a-3d7f-4d67-ac89-0f19d3960127 admin admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:54:45.081040 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 607/1226] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 23 00:54:44 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 23 00:54:45.085181 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab3301-4f66-4619-84ec-e4803c9dca52 admin admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:54:45.091045 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f036a-3d7f-4d67-ac89-0f19d3960127 admin admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:54:45.094579 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab3301-4f66-4619-84ec-e4803c9dca52 admin admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:54:45.095766 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12873c-9c6a-4737-9f27-a4ecea88c987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:54:45.096361 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12873c-9c6a-4737-9f27-a4ecea88c987 admin admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:45.096643 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12873c-9c6a-4737-9f27-a4ecea88c987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:45.096914 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12873c-9c6a-4737-9f27-a4ecea88c987 admin admin] PATH_INFO: `/v3/roles` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:45.097540 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa12873c-9c6a-4737-9f27-a4ecea88c987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:54:45.099212 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa12873c-9c6a-4737-9f27-a4ecea88c987 admin admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:54:45.099353 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149280a5-f4c5-45c2-a73b-080515ebfdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:54:45.100117 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149280a5-f4c5-45c2-a73b-080515ebfdec admin admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:45.100396 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149280a5-f4c5-45c2-a73b-080515ebfdec admin admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:45.100669 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149280a5-f4c5-45c2-a73b-080515ebfdec admin admin] PATH_INFO: `/v3/roles` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:45.101333 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149280a5-f4c5-45c2-a73b-080515ebfdec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:54:45.102933 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149280a5-f4c5-45c2-a73b-080515ebfdec admin admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:54:45.112255 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 620/1227] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 23 00:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:54:45.113385 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 608/1228] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 23 00:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:54:45.113908 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12873c-9c6a-4737-9f27-a4ecea88c987 admin admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:54:45.116826 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149280a5-f4c5-45c2-a73b-080515ebfdec admin admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:54:45.123807 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12873c-9c6a-4737-9f27-a4ecea88c987 admin admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:54:45.126487 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149280a5-f4c5-45c2-a73b-080515ebfdec admin admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:54:45.128956 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f757d0e-40ca-4e6e-a902-8820c80b7742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:54:45.129534 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f757d0e-40ca-4e6e-a902-8820c80b7742 admin admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:45.129814 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f757d0e-40ca-4e6e-a902-8820c80b7742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:45.130164 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f757d0e-40ca-4e6e-a902-8820c80b7742 admin admin] PATH_INFO: `/v3/roles` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:45.130740 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f757d0e-40ca-4e6e-a902-8820c80b7742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:54:45.131768 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e1fda-01ab-4daa-981a-1a1716d0f3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:54:45.132319 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f757d0e-40ca-4e6e-a902-8820c80b7742 admin admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:54:45.132430 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e1fda-01ab-4daa-981a-1a1716d0f3ba admin admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:45.132650 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e1fda-01ab-4daa-981a-1a1716d0f3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:45.132926 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e1fda-01ab-4daa-981a-1a1716d0f3ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:45.133706 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08e1fda-01ab-4daa-981a-1a1716d0f3ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:54:45.135351 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08e1fda-01ab-4daa-981a-1a1716d0f3ba admin admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:54:45.142955 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 621/1229] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 23 00:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:54:45.146903 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 609/1230] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 23 00:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:54:45.147509 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f757d0e-40ca-4e6e-a902-8820c80b7742 admin admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:54:45.150343 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e1fda-01ab-4daa-981a-1a1716d0f3ba admin admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:54:45.156999 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f757d0e-40ca-4e6e-a902-8820c80b7742 admin admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:54:45.160238 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e1fda-01ab-4daa-981a-1a1716d0f3ba admin admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:54:45.162225 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0fa99c-7343-47a5-81ce-4f64dd9c1098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:54:45.162855 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fa99c-7343-47a5-81ce-4f64dd9c1098 admin admin] REQUEST_METHOD: `PUT` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:45.163135 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fa99c-7343-47a5-81ce-4f64dd9c1098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:45.163406 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fa99c-7343-47a5-81ce-4f64dd9c1098 admin admin] PATH_INFO: `/v3/projects/c0e3d13411094438a53a403b1e8636cf/users/478f31c5215b44038cede750ec95168b/roles/130c11043623491c8f8e67ecb6f3efbc` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:45.164777 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48d9e5-6652-4f81-9ddf-266fa97e4e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:54:45.165392 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48d9e5-6652-4f81-9ddf-266fa97e4e67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:45.165667 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48d9e5-6652-4f81-9ddf-266fa97e4e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:45.165940 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48d9e5-6652-4f81-9ddf-266fa97e4e67 admin admin] PATH_INFO: `/v3/projects/ddb09ea4eac54254baab5c2ec5455f67/users/cf373307105d4d598e55154bcc2f400d/roles/130c11043623491c8f8e67ecb6f3efbc` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:45.179104 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0fa99c-7343-47a5-81ce-4f64dd9c1098 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0e3d13411094438a53a403b1e8636cf, user_id=478f31c5215b44038cede750ec95168b, role_id=130c11043623491c8f8e67ecb6f3efbc)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:54:45.180995 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d48d9e5-6652-4f81-9ddf-266fa97e4e67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddb09ea4eac54254baab5c2ec5455f67, user_id=cf373307105d4d598e55154bcc2f400d, role_id=130c11043623491c8f8e67ecb6f3efbc)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:54:45.182017 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0fa99c-7343-47a5-81ce-4f64dd9c1098 admin admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:54:45.183939 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d48d9e5-6652-4f81-9ddf-266fa97e4e67 admin admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:54:45.195836 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 622/1231] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 23 00:54:45 2022] PUT /identity/v3/projects/c0e3d13411094438a53a403b1e8636cf/users/478f31c5215b44038cede750ec95168b/roles/130c11043623491c8f8e67ecb6f3efbc => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:54:45.197750 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 610/1232] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 23 00:54:45 2022] PUT /identity/v3/projects/ddb09ea4eac54254baab5c2ec5455f67/users/cf373307105d4d598e55154bcc2f400d/roles/130c11043623491c8f8e67ecb6f3efbc => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 00:54:45.202535 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4867a-cd46-414b-bc04-ca044569bd3c None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:45.202713 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a239b7-5855-4dd0-81a5-ef157a60ada1 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:45.202827 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4867a-cd46-414b-bc04-ca044569bd3c None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:45.202922 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a239b7-5855-4dd0-81a5-ef157a60ada1 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:45.203079 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4867a-cd46-414b-bc04-ca044569bd3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:45.203191 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a239b7-5855-4dd0-81a5-ef157a60ada1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:45.222156 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-f3a4867a-cd46-414b-bc04-ca044569bd3c None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:54:45.223584 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-f3a4867a-cd46-414b-bc04-ca044569bd3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:54:45.232430 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-a1a239b7-5855-4dd0-81a5-ef157a60ada1 None None] MFA Rules not processed for user `39aa566fa6c64c41804fb6eefcbf0c20`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:54:45.233662 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-a1a239b7-5855-4dd0-81a5-ef157a60ada1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:54:45.269744 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:54:45.280979 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:54:45.288712 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 611/1233] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 23 00:54:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:54:45.298759 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a4867a-cd46-414b-bc04-ca044569bd3c None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:54:45.299793 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 623/1234] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 23 00:54:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:54:45.309644 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a239b7-5855-4dd0-81a5-ef157a60ada1 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:54:45.363579 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a4867a-cd46-414b-bc04-ca044569bd3c None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:54:45.366179 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a239b7-5855-4dd0-81a5-ef157a60ada1 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:54:45.367267 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd05e30-5ef5-49cc-8d56-99a88fe600c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04804cfc28b84d398ef06e8e113a755d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:54:45.367873 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd05e30-5ef5-49cc-8d56-99a88fe600c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:45.368155 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd05e30-5ef5-49cc-8d56-99a88fe600c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:45.368427 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd05e30-5ef5-49cc-8d56-99a88fe600c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:45.369888 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c50c0-b121-4eb8-8a76-a966768ceefd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04804cfc28b84d398ef06e8e113a755d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:54:45.370539 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c50c0-b121-4eb8-8a76-a966768ceefd service neutron] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:45.370820 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c50c0-b121-4eb8-8a76-a966768ceefd service neutron] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:45.371095 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c50c0-b121-4eb8-8a76-a966768ceefd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:45.377835 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd05e30-5ef5-49cc-8d56-99a88fe600c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:54:45.380176 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd05e30-5ef5-49cc-8d56-99a88fe600c3 service neutron] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:54:45.380735 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7c50c0-b121-4eb8-8a76-a966768ceefd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:54:45.382212 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7c50c0-b121-4eb8-8a76-a966768ceefd service neutron] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:54:45.391830 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 624/1235] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:54:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 00:54:45.392284 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 612/1236] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:54:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 00:54:50.364000 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1704237-8c5a-44c6-955e-3ea07e1b58b6 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:50.364459 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1704237-8c5a-44c6-955e-3ea07e1b58b6 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:50.364561 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1704237-8c5a-44c6-955e-3ea07e1b58b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:50.401827 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-e1704237-8c5a-44c6-955e-3ea07e1b58b6 None None] MFA Rules not processed for user `cf373307105d4d598e55154bcc2f400d`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:54:50.403543 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-e1704237-8c5a-44c6-955e-3ea07e1b58b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:54:50.553531 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 625/1237] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 23 00:54:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:54:50.557258 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd05e30-5ef5-49cc-8d56-99a88fe600c3 service neutron] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:54:50.569961 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd05e30-5ef5-49cc-8d56-99a88fe600c3 service neutron] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:54:50.578914 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc16483-9479-4bc2-a86e-df096e0c1193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:54:50.580031 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc16483-9479-4bc2-a86e-df096e0c1193 admin admin] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:50.580480 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc16483-9479-4bc2-a86e-df096e0c1193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:50.580941 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc16483-9479-4bc2-a86e-df096e0c1193 admin admin] PATH_INFO: `/v3/projects` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:50.581747 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc16483-9479-4bc2-a86e-df096e0c1193 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:54:50.583990 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc16483-9479-4bc2-a86e-df096e0c1193 admin admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:54:50.625784 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 613/1238] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 23 00:54:50 2022] POST /identity/v3/projects => generated 383 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:54:50.627659 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1704237-8c5a-44c6-955e-3ea07e1b58b6 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:54:50.647830 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1704237-8c5a-44c6-955e-3ea07e1b58b6 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:54:50.765358 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb62c78-cf58-4bdd-aaf0-5fbbe1440076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:54:50.766267 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb62c78-cf58-4bdd-aaf0-5fbbe1440076 admin admin] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:50.766726 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb62c78-cf58-4bdd-aaf0-5fbbe1440076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:50.767156 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb62c78-cf58-4bdd-aaf0-5fbbe1440076 admin admin] PATH_INFO: `/v3/users` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:50.769708 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb62c78-cf58-4bdd-aaf0-5fbbe1440076 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:54:50.773427 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb62c78-cf58-4bdd-aaf0-5fbbe1440076 admin admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:54:50.826533 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 626/1239] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 23 00:54:50 2022] POST /identity/v3/users => generated 298 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:54:50.827774 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc16483-9479-4bc2-a86e-df096e0c1193 admin admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:54:50.840658 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc16483-9479-4bc2-a86e-df096e0c1193 admin admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:54:50.852432 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f926b50-1237-4c65-80d5-2e4ced757d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:54:50.852832 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f926b50-1237-4c65-80d5-2e4ced757d6e admin admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:50.853091 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f926b50-1237-4c65-80d5-2e4ced757d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:50.853402 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f926b50-1237-4c65-80d5-2e4ced757d6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:50.854109 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f926b50-1237-4c65-80d5-2e4ced757d6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:54:50.856863 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f926b50-1237-4c65-80d5-2e4ced757d6e admin admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:54:50.876933 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 614/1240] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 23 00:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:54:50.879085 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb62c78-cf58-4bdd-aaf0-5fbbe1440076 admin admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:54:50.889547 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb62c78-cf58-4bdd-aaf0-5fbbe1440076 admin admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:54:50.895765 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2b9c1-4e38-4d6f-9cfd-4b8bd3d1749a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:54:50.896456 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2b9c1-4e38-4d6f-9cfd-4b8bd3d1749a admin admin] REQUEST_METHOD: `PUT` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:50.896738 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2b9c1-4e38-4d6f-9cfd-4b8bd3d1749a admin admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:50.897013 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2b9c1-4e38-4d6f-9cfd-4b8bd3d1749a admin admin] PATH_INFO: `/v3/projects/0d2881f36862464389c29e2ee3afb41c/users/a11186c8a8ab4189a508a664158297c7/roles/1e2073be75174689aa4fac29e674583d` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:50.902318 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:54:50.918580 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c2b9c1-4e38-4d6f-9cfd-4b8bd3d1749a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d2881f36862464389c29e2ee3afb41c, user_id=a11186c8a8ab4189a508a664158297c7, role_id=1e2073be75174689aa4fac29e674583d)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:54:50.922987 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c2b9c1-4e38-4d6f-9cfd-4b8bd3d1749a admin admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:54:50.948313 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f926b50-1237-4c65-80d5-2e4ced757d6e admin admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:54:50.949027 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 627/1241] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 23 00:54:50 2022] PUT /identity/v3/projects/0d2881f36862464389c29e2ee3afb41c/users/a11186c8a8ab4189a508a664158297c7/roles/1e2073be75174689aa4fac29e674583d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:54:50.960624 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f926b50-1237-4c65-80d5-2e4ced757d6e admin admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:54:51.038917 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b9eab-d912-411f-9d0b-f2a023be82d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:54:51.039624 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b9eab-d912-411f-9d0b-f2a023be82d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:51.039986 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b9eab-d912-411f-9d0b-f2a023be82d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:51.040335 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b9eab-d912-411f-9d0b-f2a023be82d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:51.041073 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18b9eab-d912-411f-9d0b-f2a023be82d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:54:51.043059 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18b9eab-d912-411f-9d0b-f2a023be82d4 admin admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:54:51.062330 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 615/1242] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 23 00:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 23 00:54:51.063757 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2b9c1-4e38-4d6f-9cfd-4b8bd3d1749a admin admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:54:51.078885 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2b9c1-4e38-4d6f-9cfd-4b8bd3d1749a admin admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:54:51.084498 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ca855-2e83-42c3-955c-cb332c59345c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:54:51.085112 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ca855-2e83-42c3-955c-cb332c59345c admin admin] REQUEST_METHOD: `PUT` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:51.085414 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ca855-2e83-42c3-955c-cb332c59345c admin admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:51.085655 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ca855-2e83-42c3-955c-cb332c59345c admin admin] PATH_INFO: `/v3/projects/0d2881f36862464389c29e2ee3afb41c/users/a11186c8a8ab4189a508a664158297c7/roles/1e2073be75174689aa4fac29e674583d` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:51.087955 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825ca855-2e83-42c3-955c-cb332c59345c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d2881f36862464389c29e2ee3afb41c, user_id=a11186c8a8ab4189a508a664158297c7, role_id=1e2073be75174689aa4fac29e674583d)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:54:51.091110 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825ca855-2e83-42c3-955c-cb332c59345c admin admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:54:51.109202 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 628/1243] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 23 00:54:51 2022] PUT /identity/v3/projects/0d2881f36862464389c29e2ee3afb41c/users/a11186c8a8ab4189a508a664158297c7/roles/1e2073be75174689aa4fac29e674583d => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:54:51.539673 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad25e5f-527a-4d24-845b-87401ac524e8 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:51.540041 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad25e5f-527a-4d24-845b-87401ac524e8 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:51.540220 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad25e5f-527a-4d24-845b-87401ac524e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:51.570553 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-8ad25e5f-527a-4d24-845b-87401ac524e8 None None] MFA Rules not processed for user `478f31c5215b44038cede750ec95168b`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:54:51.571994 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-8ad25e5f-527a-4d24-845b-87401ac524e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:54:51.641538 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:54:51.679010 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 616/1244] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 23 00:54:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:54:51.683639 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ca855-2e83-42c3-955c-cb332c59345c admin admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:54:51.782373 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ca855-2e83-42c3-955c-cb332c59345c admin admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:54:51.800933 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cfa1f5-37a2-4335-ba43-920746472062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:54:51.801675 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfa1f5-37a2-4335-ba43-920746472062 admin admin] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:51.802100 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfa1f5-37a2-4335-ba43-920746472062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:51.802379 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfa1f5-37a2-4335-ba43-920746472062 admin admin] PATH_INFO: `/v3/projects` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:51.804173 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cfa1f5-37a2-4335-ba43-920746472062 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:54:51.808635 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cfa1f5-37a2-4335-ba43-920746472062 admin admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:54:51.875365 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 629/1245] 10.222.0.23 () {60 vars in 1153 bytes} [Sun Oct 23 00:54:51 2022] POST /identity/v3/projects => generated 379 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:54:51.879330 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad25e5f-527a-4d24-845b-87401ac524e8 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:54:51.894166 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad25e5f-527a-4d24-845b-87401ac524e8 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:54:51.988851 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32fe37d-9d8b-400f-9d58-0178ef59ecbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:54:51.992196 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fe37d-9d8b-400f-9d58-0178ef59ecbf admin admin] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:51.992491 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fe37d-9d8b-400f-9d58-0178ef59ecbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:51.992901 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fe37d-9d8b-400f-9d58-0178ef59ecbf admin admin] PATH_INFO: `/v3/users` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:51.994915 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32fe37d-9d8b-400f-9d58-0178ef59ecbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:54:51.998405 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32fe37d-9d8b-400f-9d58-0178ef59ecbf admin admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:54:52.037043 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 617/1246] 10.222.0.23 () {60 vars in 1144 bytes} [Sun Oct 23 00:54:51 2022] POST /identity/v3/users => generated 296 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 23 00:54:52.041102 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cfa1f5-37a2-4335-ba43-920746472062 admin admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:54:52.062315 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cfa1f5-37a2-4335-ba43-920746472062 admin admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:54:52.076820 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1b25d-456b-4c47-a28f-09a68dad2c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:54:52.081762 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1b25d-456b-4c47-a28f-09a68dad2c7a admin admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:52.081762 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1b25d-456b-4c47-a28f-09a68dad2c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:52.081762 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1b25d-456b-4c47-a28f-09a68dad2c7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:52.081762 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff1b25d-456b-4c47-a28f-09a68dad2c7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:54:52.083511 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff1b25d-456b-4c47-a28f-09a68dad2c7a admin admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:54:52.099304 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 630/1247] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 23 00:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:54:52.101519 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32fe37d-9d8b-400f-9d58-0178ef59ecbf admin admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:54:52.130990 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32fe37d-9d8b-400f-9d58-0178ef59ecbf admin admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:54:52.137013 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f58f71-d31c-4a3f-b29f-aa486d936c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:54:52.138354 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f58f71-d31c-4a3f-b29f-aa486d936c8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:52.138354 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f58f71-d31c-4a3f-b29f-aa486d936c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:52.138604 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f58f71-d31c-4a3f-b29f-aa486d936c8a admin admin] PATH_INFO: `/v3/projects/80857ec283804378966c744c4bb14461/users/cd08ad9f9ac1413cadfc4f7c92e114bb/roles/1e2073be75174689aa4fac29e674583d` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:52.166209 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f58f71-d31c-4a3f-b29f-aa486d936c8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=80857ec283804378966c744c4bb14461, user_id=cd08ad9f9ac1413cadfc4f7c92e114bb, role_id=1e2073be75174689aa4fac29e674583d)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:54:52.169425 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f58f71-d31c-4a3f-b29f-aa486d936c8a admin admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:54:52.191793 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 618/1248] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 23 00:54:52 2022] PUT /identity/v3/projects/80857ec283804378966c744c4bb14461/users/cd08ad9f9ac1413cadfc4f7c92e114bb/roles/1e2073be75174689aa4fac29e674583d => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:54:52.196634 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1b25d-456b-4c47-a28f-09a68dad2c7a admin admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:54:52.216476 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1b25d-456b-4c47-a28f-09a68dad2c7a admin admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:54:52.327040 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346557fb-ae70-402f-b318-dea2daf3693d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:54:52.327690 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346557fb-ae70-402f-b318-dea2daf3693d admin admin] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:52.327974 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346557fb-ae70-402f-b318-dea2daf3693d admin admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:52.328250 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346557fb-ae70-402f-b318-dea2daf3693d admin admin] PATH_INFO: `/v3/roles` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:52.329898 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346557fb-ae70-402f-b318-dea2daf3693d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:54:52.331730 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346557fb-ae70-402f-b318-dea2daf3693d admin admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:54:52.361393 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 631/1249] 10.222.0.23 () {58 vars in 1122 bytes} [Sun Oct 23 00:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 23 00:54:52.366104 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f58f71-d31c-4a3f-b29f-aa486d936c8a admin admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:54:52.393190 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f58f71-d31c-4a3f-b29f-aa486d936c8a admin admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:54:52.399645 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370af258-1fc7-4716-8fa9-a2b21e0bed9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:54:52.400641 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370af258-1fc7-4716-8fa9-a2b21e0bed9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:52.401204 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370af258-1fc7-4716-8fa9-a2b21e0bed9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:52.401690 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370af258-1fc7-4716-8fa9-a2b21e0bed9f admin admin] PATH_INFO: `/v3/projects/80857ec283804378966c744c4bb14461/users/cd08ad9f9ac1413cadfc4f7c92e114bb/roles/1e2073be75174689aa4fac29e674583d` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:52.408690 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370af258-1fc7-4716-8fa9-a2b21e0bed9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=80857ec283804378966c744c4bb14461, user_id=cd08ad9f9ac1413cadfc4f7c92e114bb, role_id=1e2073be75174689aa4fac29e674583d)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:54:52.412997 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370af258-1fc7-4716-8fa9-a2b21e0bed9f admin admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:54:52.430816 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 619/1250] 10.222.0.23 () {60 vars in 1483 bytes} [Sun Oct 23 00:54:52 2022] PUT /identity/v3/projects/80857ec283804378966c744c4bb14461/users/cd08ad9f9ac1413cadfc4f7c92e114bb/roles/1e2073be75174689aa4fac29e674583d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 00:54:56.969913 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8780d28-d97a-4e1e-a29c-b72dac9540f3 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:56.970498 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8780d28-d97a-4e1e-a29c-b72dac9540f3 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:56.970498 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8780d28-d97a-4e1e-a29c-b72dac9540f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:57.015124 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-b8780d28-d97a-4e1e-a29c-b72dac9540f3 None None] MFA Rules not processed for user `a11186c8a8ab4189a508a664158297c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:54:57.016392 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-b8780d28-d97a-4e1e-a29c-b72dac9540f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:54:57.069536 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:54:57.135427 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 632/1251] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 23 00:54:56 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:54:57.145144 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370af258-1fc7-4716-8fa9-a2b21e0bed9f admin admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:54:57.147066 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-370af258-1fc7-4716-8fa9-a2b21e0bed9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:54:57.307816 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370af258-1fc7-4716-8fa9-a2b21e0bed9f admin admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:54:57.312941 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8088835-0db7-41a0-9267-783ec11b9a52 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b94f1f12db3473f9ce1f33d2d9056a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:54:57.313574 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8088835-0db7-41a0-9267-783ec11b9a52 service glance] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:57.314052 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8088835-0db7-41a0-9267-783ec11b9a52 service glance] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:57.314492 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8088835-0db7-41a0-9267-783ec11b9a52 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:57.359440 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:54:57.409406 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8088835-0db7-41a0-9267-783ec11b9a52 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:54:57.410955 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8088835-0db7-41a0-9267-783ec11b9a52 service glance] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:54:57.437723 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 620/1252] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:54:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:54:57.726204 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdce000-404a-42ea-8a13-aae61daf46dc None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:57.726784 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdce000-404a-42ea-8a13-aae61daf46dc None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:57.727316 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdce000-404a-42ea-8a13-aae61daf46dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:57.816175 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-cbdce000-404a-42ea-8a13-aae61daf46dc None None] MFA Rules not processed for user `f183fd83a96a4af0bc9df03e6f61ca4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:54:57.817470 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-cbdce000-404a-42ea-8a13-aae61daf46dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:54:57.899387 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 633/1253] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 23 00:54:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:54:58.035951 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8088835-0db7-41a0-9267-783ec11b9a52 service glance] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:54:58.037448 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-e8088835-0db7-41a0-9267-783ec11b9a52 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:54:58.172753 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8088835-0db7-41a0-9267-783ec11b9a52 service glance] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:54:58.195397 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16513ab-0c4a-4f8d-b02c-92082d83acc7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84a0345be05644e3a7a71c5a2bf21c41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:54:58.197681 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16513ab-0c4a-4f8d-b02c-92082d83acc7 service swift] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:58.198224 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16513ab-0c4a-4f8d-b02c-92082d83acc7 service swift] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:58.198709 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16513ab-0c4a-4f8d-b02c-92082d83acc7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:58.217684 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16513ab-0c4a-4f8d-b02c-92082d83acc7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:54:58.221890 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16513ab-0c4a-4f8d-b02c-92082d83acc7 service swift] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:54:58.238822 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 621/1254] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 23 00:54:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 00:54:58.724162 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb3ab9-454e-4ad7-87c8-474ca916b6ab None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:58.724940 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb3ab9-454e-4ad7-87c8-474ca916b6ab None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:58.724940 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb3ab9-454e-4ad7-87c8-474ca916b6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:58.765821 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-6bbb3ab9-454e-4ad7-87c8-474ca916b6ab None None] MFA Rules not processed for user `cd08ad9f9ac1413cadfc4f7c92e114bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:54:58.767383 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-6bbb3ab9-454e-4ad7-87c8-474ca916b6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:54:58.881662 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 634/1255] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 23 00:54:58 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:54:58.897633 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16513ab-0c4a-4f8d-b02c-92082d83acc7 service swift] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:54:58.912667 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16513ab-0c4a-4f8d-b02c-92082d83acc7 service swift] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:54:58.921862 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f116decb-daf9-435a-ae5a-57df19322e82 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b94f1f12db3473f9ce1f33d2d9056a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:54:58.922515 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116decb-daf9-435a-ae5a-57df19322e82 service glance] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:54:58.922793 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116decb-daf9-435a-ae5a-57df19322e82 service glance] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:54:58.923063 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116decb-daf9-435a-ae5a-57df19322e82 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:54:59.021574 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f116decb-daf9-435a-ae5a-57df19322e82 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:54:59.023182 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f116decb-daf9-435a-ae5a-57df19322e82 service glance] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:54:59.033171 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 622/1256] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:54:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:55:00.758989 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a8425-8184-405f-b2d8-53ee687fb2ee None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:55:00.759982 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a8425-8184-405f-b2d8-53ee687fb2ee None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:55:00.760488 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a8425-8184-405f-b2d8-53ee687fb2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:55:00.796791 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-894a8425-8184-405f-b2d8-53ee687fb2ee None None] MFA Rules not processed for user `f183fd83a96a4af0bc9df03e6f61ca4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:55:00.799258 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-894a8425-8184-405f-b2d8-53ee687fb2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:55:00.826880 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 635/1257] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 23 00:55:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:55:00.855451 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f116decb-daf9-435a-ae5a-57df19322e82 service glance] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:55:00.873933 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f116decb-daf9-435a-ae5a-57df19322e82 service glance] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:55:00.885458 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a010256-0ce8-49b2-bfa8-eb4501b72cfb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84a0345be05644e3a7a71c5a2bf21c41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:55:00.886114 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a010256-0ce8-49b2-bfa8-eb4501b72cfb service swift] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:55:00.886413 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a010256-0ce8-49b2-bfa8-eb4501b72cfb service swift] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:55:00.886690 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a010256-0ce8-49b2-bfa8-eb4501b72cfb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:55:00.896257 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a010256-0ce8-49b2-bfa8-eb4501b72cfb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:55:00.897878 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a010256-0ce8-49b2-bfa8-eb4501b72cfb service swift] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:55:00.915480 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 623/1258] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 23 00:55:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 00:55:08.938503 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b4129-f499-4ce0-913a-7b881f51d39c None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:55:08.939039 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b4129-f499-4ce0-913a-7b881f51d39c None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:55:08.939039 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b4129-f499-4ce0-913a-7b881f51d39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:55:08.959747 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-fc7b4129-f499-4ce0-913a-7b881f51d39c None None] MFA Rules not processed for user `cf373307105d4d598e55154bcc2f400d`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:55:08.961817 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-fc7b4129-f499-4ce0-913a-7b881f51d39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:55:08.969541 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 636/1259] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 23 00:55:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:55:09.303580 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930de11-8fb7-43ab-840b-fc3f110ef148 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:55:09.304549 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930de11-8fb7-43ab-840b-fc3f110ef148 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:55:09.304995 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930de11-8fb7-43ab-840b-fc3f110ef148 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:55:09.306866 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 624/1260] 10.222.0.23 () {54 vars in 961 bytes} [Sun Oct 23 00:55:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:55:09.316763 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46798bfe-2162-4562-bbb7-a40009105b1c None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:55:09.317285 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46798bfe-2162-4562-bbb7-a40009105b1c None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:55:09.317720 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46798bfe-2162-4562-bbb7-a40009105b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:55:09.338722 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=100 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:55:09.362890 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-46798bfe-2162-4562-bbb7-a40009105b1c None None] MFA Rules not processed for user `90f691140a8341ada73a8c6f01ad798c`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:55:09.364295 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-46798bfe-2162-4562-bbb7-a40009105b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:55:09.443294 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 637/1261] 10.222.0.23 () {58 vars in 1058 bytes} [Sun Oct 23 00:55:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:55:09.448658 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835b30a-edb8-4e96-879b-6df3da17d24b None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:55:09.449100 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835b30a-edb8-4e96-879b-6df3da17d24b None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:55:09.449399 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835b30a-edb8-4e96-879b-6df3da17d24b None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:55:09.451145 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 625/1262] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 23 00:55:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:55:09.457433 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46037403-a1e2-4870-9397-e4d168657a19 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:55:09.459051 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46037403-a1e2-4870-9397-e4d168657a19 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:55:09.459051 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46037403-a1e2-4870-9397-e4d168657a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:55:09.480173 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-46037403-a1e2-4870-9397-e4d168657a19 None None] MFA Rules not processed for user `90f691140a8341ada73a8c6f01ad798c`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:55:09.481585 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-46037403-a1e2-4870-9397-e4d168657a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:55:09.491731 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 638/1263] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 23 00:55:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:55:09.504934 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7835b30a-edb8-4e96-879b-6df3da17d24b None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:55:09.506931 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-7835b30a-edb8-4e96-879b-6df3da17d24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:55:09.522608 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7835b30a-edb8-4e96-879b-6df3da17d24b None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:55:09.526572 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac936e-db9d-497c-ad28-fe8693aa81f7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b94f1f12db3473f9ce1f33d2d9056a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:55:09.527209 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac936e-db9d-497c-ad28-fe8693aa81f7 service glance] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:55:09.527558 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac936e-db9d-497c-ad28-fe8693aa81f7 service glance] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:55:09.527908 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac936e-db9d-497c-ad28-fe8693aa81f7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:55:09.540351 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac936e-db9d-497c-ad28-fe8693aa81f7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:55:09.541912 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac936e-db9d-497c-ad28-fe8693aa81f7 service glance] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:55:09.554739 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 626/1264] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:55:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:55:09.971434 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa527a5e-b00d-4c96-af34-b6169f41bea5 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:55:09.972283 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa527a5e-b00d-4c96-af34-b6169f41bea5 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:55:09.972283 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa527a5e-b00d-4c96-af34-b6169f41bea5 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:55:09.973701 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 639/1265] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 23 00:55:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:55:09.979688 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd2128-b9a1-4bde-9061-819ac1fdf930 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:55:09.980277 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd2128-b9a1-4bde-9061-819ac1fdf930 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:55:09.980558 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd2128-b9a1-4bde-9061-819ac1fdf930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:55:10.006839 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=100 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:55:10.035790 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-c5bd2128-b9a1-4bde-9061-819ac1fdf930 None None] MFA Rules not processed for user `04804cfc28b84d398ef06e8e113a755d`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:55:10.037098 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-c5bd2128-b9a1-4bde-9061-819ac1fdf930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:55:10.114338 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 627/1266] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 23 00:55:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:55:10.125621 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa527a5e-b00d-4c96-af34-b6169f41bea5 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:55:10.129293 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-fa527a5e-b00d-4c96-af34-b6169f41bea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:55:10.150185 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa527a5e-b00d-4c96-af34-b6169f41bea5 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:55:10.154391 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57680cf4-2bbb-4f17-ae90-2785a6e8042b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04804cfc28b84d398ef06e8e113a755d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:55:10.155288 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57680cf4-2bbb-4f17-ae90-2785a6e8042b service neutron] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:55:10.155965 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57680cf4-2bbb-4f17-ae90-2785a6e8042b service neutron] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:55:10.156400 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57680cf4-2bbb-4f17-ae90-2785a6e8042b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:55:10.166390 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57680cf4-2bbb-4f17-ae90-2785a6e8042b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:55:10.168533 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57680cf4-2bbb-4f17-ae90-2785a6e8042b service neutron] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:55:10.194577 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 640/1267] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:55:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:55:10.633893 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6fb32-53fa-4a7a-a453-c52813080bb3 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:55:10.635027 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6fb32-53fa-4a7a-a453-c52813080bb3 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:55:10.635553 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6fb32-53fa-4a7a-a453-c52813080bb3 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:55:10.637167 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 628/1268] 10.222.0.23 () {54 vars in 961 bytes} [Sun Oct 23 00:55:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:55:10.642904 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f387a6-afac-4e7c-b557-26b08f91ef96 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:55:10.643189 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f387a6-afac-4e7c-b557-26b08f91ef96 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:55:10.643468 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f387a6-afac-4e7c-b557-26b08f91ef96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:55:10.651535 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6fb32-53fa-4a7a-a453-c52813080bb3 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:55:10.672308 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-96f387a6-afac-4e7c-b557-26b08f91ef96 None None] MFA Rules not processed for user `90f691140a8341ada73a8c6f01ad798c`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:55:10.674570 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-96f387a6-afac-4e7c-b557-26b08f91ef96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:55:10.685869 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 641/1269] 10.222.0.23 () {58 vars in 1058 bytes} [Sun Oct 23 00:55:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:55:10.692044 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f163af18-95c4-4edc-a76e-4fbebc73ddc6 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:55:10.692342 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f163af18-95c4-4edc-a76e-4fbebc73ddc6 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:55:10.692615 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f163af18-95c4-4edc-a76e-4fbebc73ddc6 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:55:10.693883 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 642/1270] 10.222.0.23 () {54 vars in 912 bytes} [Sun Oct 23 00:55:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 23 00:55:10.698556 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fda438-3ba1-44db-9b1c-271b44c55037 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:55:10.698913 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fda438-3ba1-44db-9b1c-271b44c55037 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:55:10.699265 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fda438-3ba1-44db-9b1c-271b44c55037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:55:10.718584 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-98fda438-3ba1-44db-9b1c-271b44c55037 None None] MFA Rules not processed for user `90f691140a8341ada73a8c6f01ad798c`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:55:10.719817 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-98fda438-3ba1-44db-9b1c-271b44c55037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:55:10.726699 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6fb32-53fa-4a7a-a453-c52813080bb3 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:55:10.729702 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 643/1271] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 23 00:55:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:55:10.731638 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e1df6-242e-4c6f-870f-ee101e4222f3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1863d19ad4624ea496c2c73b70ae0c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:55:10.732243 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e1df6-242e-4c6f-870f-ee101e4222f3 service placement] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:55:10.732523 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e1df6-242e-4c6f-870f-ee101e4222f3 service placement] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:55:10.732799 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e1df6-242e-4c6f-870f-ee101e4222f3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:55:10.734546 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-e98e1df6-242e-4c6f-870f-ee101e4222f3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:55:10.742434 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fda438-3ba1-44db-9b1c-271b44c55037 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:55:10.746868 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e1df6-242e-4c6f-870f-ee101e4222f3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:55:10.748529 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e1df6-242e-4c6f-870f-ee101e4222f3 service placement] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:55:10.751177 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fda438-3ba1-44db-9b1c-271b44c55037 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:55:10.755401 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8b8fc-a0d9-44c6-a253-b7e98c388718 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04804cfc28b84d398ef06e8e113a755d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:55:10.755994 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8b8fc-a0d9-44c6-a253-b7e98c388718 service neutron] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:55:10.756271 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8b8fc-a0d9-44c6-a253-b7e98c388718 service neutron] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:55:10.756549 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8b8fc-a0d9-44c6-a253-b7e98c388718 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:55:10.759901 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 629/1272] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:55:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 00:55:10.767234 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e8b8fc-a0d9-44c6-a253-b7e98c388718 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:55:10.769557 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e8b8fc-a0d9-44c6-a253-b7e98c388718 service neutron] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:55:10.780198 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 644/1273] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:55:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 00:55:12.633257 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738c490-5f35-4dd3-8cc5-56a4ce7e9c84 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:55:12.633734 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738c490-5f35-4dd3-8cc5-56a4ce7e9c84 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:55:12.633940 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738c490-5f35-4dd3-8cc5-56a4ce7e9c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:55:12.653329 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-9738c490-5f35-4dd3-8cc5-56a4ce7e9c84 None None] MFA Rules not processed for user `f183fd83a96a4af0bc9df03e6f61ca4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:55:12.654583 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-9738c490-5f35-4dd3-8cc5-56a4ce7e9c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:55:12.662767 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 630/1274] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 23 00:55:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:55:12.677774 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8b8fc-a0d9-44c6-a253-b7e98c388718 service neutron] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:55:12.688551 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8b8fc-a0d9-44c6-a253-b7e98c388718 service neutron] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:55:12.693664 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b6dab-9ba3-41d2-9f68-0fa01adccd30 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84a0345be05644e3a7a71c5a2bf21c41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:55:12.694503 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b6dab-9ba3-41d2-9f68-0fa01adccd30 service swift] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:55:12.694789 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b6dab-9ba3-41d2-9f68-0fa01adccd30 service swift] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:55:12.695065 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b6dab-9ba3-41d2-9f68-0fa01adccd30 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:55:12.703280 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324b6dab-9ba3-41d2-9f68-0fa01adccd30 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:55:12.704921 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324b6dab-9ba3-41d2-9f68-0fa01adccd30 service swift] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:55:12.713384 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 645/1275] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 23 00:55:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 00:55:22.648164 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=59 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:55:22.710091 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=59 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:55:27.862104 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e4dd7-ff27-4210-8def-81a1e2be1162 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:55:27.862104 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e4dd7-ff27-4210-8def-81a1e2be1162 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:55:27.862104 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e4dd7-ff27-4210-8def-81a1e2be1162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:55:27.890255 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-d53e4dd7-ff27-4210-8def-81a1e2be1162 None None] MFA Rules not processed for user `04804cfc28b84d398ef06e8e113a755d`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:55:27.891793 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-d53e4dd7-ff27-4210-8def-81a1e2be1162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:55:27.899792 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 631/1276] 10.222.0.49 () {58 vars in 1015 bytes} [Sun Oct 23 00:55:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:55:27.912975 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b6dab-9ba3-41d2-9f68-0fa01adccd30 service swift] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:55:27.924179 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b6dab-9ba3-41d2-9f68-0fa01adccd30 service swift] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:55:27.928040 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286c117-1f82-425b-8c3c-beed11e47894 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04804cfc28b84d398ef06e8e113a755d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:55:27.928660 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286c117-1f82-425b-8c3c-beed11e47894 service neutron] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:55:27.936098 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286c117-1f82-425b-8c3c-beed11e47894 service neutron] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:55:27.937195 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286c117-1f82-425b-8c3c-beed11e47894 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:55:27.948028 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b286c117-1f82-425b-8c3c-beed11e47894 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:55:27.949475 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b286c117-1f82-425b-8c3c-beed11e47894 service neutron] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:55:27.966262 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 646/1277] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:55:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:55:28.811192 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa45834-d2f9-43e0-a4a4-55f0962ced9c None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:55:28.811558 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa45834-d2f9-43e0-a4a4-55f0962ced9c None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:55:28.811834 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa45834-d2f9-43e0-a4a4-55f0962ced9c None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:55:28.813211 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 632/1278] 10.222.0.23 () {54 vars in 921 bytes} [Sun Oct 23 00:55:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:55:28.819880 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeff20e-fb8c-4d76-bcf4-7d91a7e26bf5 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:55:28.820278 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeff20e-fb8c-4d76-bcf4-7d91a7e26bf5 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:55:28.820639 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeff20e-fb8c-4d76-bcf4-7d91a7e26bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:55:28.840855 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-cbeff20e-fb8c-4d76-bcf4-7d91a7e26bf5 None None] MFA Rules not processed for user `90f691140a8341ada73a8c6f01ad798c`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:55:28.842659 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-cbeff20e-fb8c-4d76-bcf4-7d91a7e26bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:55:28.852775 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 647/1279] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Oct 23 00:55:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:55:28.866661 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa45834-d2f9-43e0-a4a4-55f0962ced9c None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:55:28.881450 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa45834-d2f9-43e0-a4a4-55f0962ced9c None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:55:28.886920 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3b0304-4358-4964-a673-66ce05eda6fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90f691140a8341ada73a8c6f01ad798c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:55:28.887658 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b0304-4358-4964-a673-66ce05eda6fa service nova] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:55:28.887978 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b0304-4358-4964-a673-66ce05eda6fa service nova] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:55:28.888262 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b0304-4358-4964-a673-66ce05eda6fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:55:28.898350 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3b0304-4358-4964-a673-66ce05eda6fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:55:28.899958 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3b0304-4358-4964-a673-66ce05eda6fa service nova] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:55:28.922282 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 633/1280] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:55:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:55:36.156680 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea91c7-ae2a-46f8-996a-2658a3f29d11 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:55:36.157276 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea91c7-ae2a-46f8-996a-2658a3f29d11 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:55:36.157454 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea91c7-ae2a-46f8-996a-2658a3f29d11 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:55:36.159509 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 648/1281] 10.222.0.23 () {54 vars in 921 bytes} [Sun Oct 23 00:55:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:55:36.169700 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da080b-d333-46fe-bc7a-11d125d2a61a None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:55:36.170236 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da080b-d333-46fe-bc7a-11d125d2a61a None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:55:36.170433 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da080b-d333-46fe-bc7a-11d125d2a61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:55:36.189852 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-81da080b-d333-46fe-bc7a-11d125d2a61a None None] MFA Rules not processed for user `90f691140a8341ada73a8c6f01ad798c`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:55:36.193698 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-81da080b-d333-46fe-bc7a-11d125d2a61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:55:36.200858 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 634/1282] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Oct 23 00:55:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:55:36.217303 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea91c7-ae2a-46f8-996a-2658a3f29d11 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:55:36.233146 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea91c7-ae2a-46f8-996a-2658a3f29d11 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:55:36.238672 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0b4fe-11f5-456b-bf35-d61049b91b95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90f691140a8341ada73a8c6f01ad798c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:55:36.239280 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0b4fe-11f5-456b-bf35-d61049b91b95 service nova] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:55:36.239558 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0b4fe-11f5-456b-bf35-d61049b91b95 service nova] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:55:36.239831 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0b4fe-11f5-456b-bf35-d61049b91b95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:55:36.249354 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb0b4fe-11f5-456b-bf35-d61049b91b95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:55:36.251014 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb0b4fe-11f5-456b-bf35-d61049b91b95 service nova] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:55:36.261256 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 649/1283] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:55:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:55:46.184880 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=12 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:55:46.257030 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=15 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:55:56.884589 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512fffa-bdc3-432c-a085-a7983a78615f None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:55:56.885135 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512fffa-bdc3-432c-a085-a7983a78615f None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:55:56.885135 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512fffa-bdc3-432c-a085-a7983a78615f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:55:56.904617 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-6512fffa-bdc3-432c-a085-a7983a78615f None None] MFA Rules not processed for user `478f31c5215b44038cede750ec95168b`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:55:56.905911 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-6512fffa-bdc3-432c-a085-a7983a78615f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:55:56.913780 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 635/1284] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 23 00:55:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:56:04.377789 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0b4fe-11f5-456b-bf35-d61049b91b95 service nova] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:56:04.392646 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0b4fe-11f5-456b-bf35-d61049b91b95 service nova] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:56:04.406396 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae96f826-2471-4c51-b84e-aa464a2c32c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04804cfc28b84d398ef06e8e113a755d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:56:04.406396 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96f826-2471-4c51-b84e-aa464a2c32c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:56:04.406396 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96f826-2471-4c51-b84e-aa464a2c32c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:56:04.406396 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96f826-2471-4c51-b84e-aa464a2c32c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:56:04.410365 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae96f826-2471-4c51-b84e-aa464a2c32c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:56:04.411894 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae96f826-2471-4c51-b84e-aa464a2c32c4 service neutron] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:56:04.422058 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 650/1285] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:56:04 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:56:06.898993 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=3 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:56:09.507546 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae7622-79cf-42b8-a131-d262edc85366 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:56:09.508151 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae7622-79cf-42b8-a131-d262edc85366 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:56:09.508151 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae7622-79cf-42b8-a131-d262edc85366 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:56:09.509611 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 636/1286] 10.222.0.23 () {54 vars in 921 bytes} [Sun Oct 23 00:56:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:56:09.543520 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d1acc-7b96-4076-bada-57839677c9f0 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:56:09.544029 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d1acc-7b96-4076-bada-57839677c9f0 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:56:09.544274 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d1acc-7b96-4076-bada-57839677c9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:56:09.566867 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-555d1acc-7b96-4076-bada-57839677c9f0 None None] MFA Rules not processed for user `90f691140a8341ada73a8c6f01ad798c`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:56:09.568918 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-555d1acc-7b96-4076-bada-57839677c9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:56:09.581706 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 651/1287] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Oct 23 00:56:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:56:09.604061 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae7622-79cf-42b8-a131-d262edc85366 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:56:09.619924 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae7622-79cf-42b8-a131-d262edc85366 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:56:09.625443 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f890b9-61cc-4889-8d25-8f7cfdf1886c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90f691140a8341ada73a8c6f01ad798c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:56:09.626153 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f890b9-61cc-4889-8d25-8f7cfdf1886c service nova] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:56:09.626351 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f890b9-61cc-4889-8d25-8f7cfdf1886c service nova] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:56:09.626600 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f890b9-61cc-4889-8d25-8f7cfdf1886c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:56:09.638984 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f890b9-61cc-4889-8d25-8f7cfdf1886c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:56:09.640306 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f890b9-61cc-4889-8d25-8f7cfdf1886c service nova] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:56:09.653271 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 637/1288] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:56:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:56:19.558593 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=9 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:56:19.647679 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=6 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:56:53.999889 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297134c9-781b-44bc-b4ab-7591120628d6 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:56:54.000427 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297134c9-781b-44bc-b4ab-7591120628d6 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:56:54.000427 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297134c9-781b-44bc-b4ab-7591120628d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:56:54.020344 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-297134c9-781b-44bc-b4ab-7591120628d6 None None] MFA Rules not processed for user `478f31c5215b44038cede750ec95168b`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:56:54.021526 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-297134c9-781b-44bc-b4ab-7591120628d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:56:54.028282 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 652/1289] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 23 00:56:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:57:04.014245 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=3 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:57:12.166816 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b659451-f525-437c-9cca-9fe59dc4c02f None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:57:12.167300 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b659451-f525-437c-9cca-9fe59dc4c02f None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:57:12.167387 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b659451-f525-437c-9cca-9fe59dc4c02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:57:12.186853 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-6b659451-f525-437c-9cca-9fe59dc4c02f None None] MFA Rules not processed for user `f183fd83a96a4af0bc9df03e6f61ca4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:57:12.187993 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-6b659451-f525-437c-9cca-9fe59dc4c02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:57:12.195671 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 638/1290] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 23 00:57:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:57:12.240806 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297134c9-781b-44bc-b4ab-7591120628d6 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:57:12.252691 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297134c9-781b-44bc-b4ab-7591120628d6 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:57:12.257650 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3a8fc-37c7-4b72-9b8c-ed5ee1298aa4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84a0345be05644e3a7a71c5a2bf21c41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:57:12.258274 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3a8fc-37c7-4b72-9b8c-ed5ee1298aa4 service swift] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:57:12.258551 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3a8fc-37c7-4b72-9b8c-ed5ee1298aa4 service swift] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:57:12.258820 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3a8fc-37c7-4b72-9b8c-ed5ee1298aa4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:57:12.266613 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e3a8fc-37c7-4b72-9b8c-ed5ee1298aa4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:57:12.268189 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e3a8fc-37c7-4b72-9b8c-ed5ee1298aa4 service swift] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:57:12.276661 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 653/1291] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 23 00:57:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 00:57:17.655170 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed609cb1-f6a0-41af-8456-3f6f97ca44b4 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:57:17.655616 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed609cb1-f6a0-41af-8456-3f6f97ca44b4 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:57:17.655750 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed609cb1-f6a0-41af-8456-3f6f97ca44b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:57:17.674859 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-ed609cb1-f6a0-41af-8456-3f6f97ca44b4 None None] MFA Rules not processed for user `478f31c5215b44038cede750ec95168b`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:57:17.676699 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-ed609cb1-f6a0-41af-8456-3f6f97ca44b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:57:17.683520 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 639/1292] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 23 00:57:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:57:22.273452 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=6 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:57:27.669589 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=6 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:57:51.764755 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca957c-b0d8-40fa-9634-47010a369290 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:57:51.765271 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca957c-b0d8-40fa-9634-47010a369290 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:57:51.765361 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca957c-b0d8-40fa-9634-47010a369290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:57:51.784577 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-b3ca957c-b0d8-40fa-9634-47010a369290 None None] MFA Rules not processed for user `f183fd83a96a4af0bc9df03e6f61ca4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:57:51.785778 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-b3ca957c-b0d8-40fa-9634-47010a369290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:57:51.793029 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 654/1293] 10.222.0.23 () {58 vars in 967 bytes} [Sun Oct 23 00:57:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 00:57:51.805949 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed609cb1-f6a0-41af-8456-3f6f97ca44b4 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:57:51.817389 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed609cb1-f6a0-41af-8456-3f6f97ca44b4 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:57:51.822932 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f27e0e-c5e6-4ce9-8a39-900d8f625dd2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84a0345be05644e3a7a71c5a2bf21c41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:57:51.823529 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f27e0e-c5e6-4ce9-8a39-900d8f625dd2 service swift] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:57:51.823812 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f27e0e-c5e6-4ce9-8a39-900d8f625dd2 service swift] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:57:51.824083 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f27e0e-c5e6-4ce9-8a39-900d8f625dd2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:57:51.831859 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f27e0e-c5e6-4ce9-8a39-900d8f625dd2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:57:51.833476 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f27e0e-c5e6-4ce9-8a39-900d8f625dd2 service swift] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:57:51.841364 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 640/1294] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 23 00:57:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 00:58:01.779630 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=3 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:58:01.838231 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=6 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:58:15.671854 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e991d-b790-4f60-a07b-c162df1071a5 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:58:15.672360 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e991d-b790-4f60-a07b-c162df1071a5 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:58:15.672449 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e991d-b790-4f60-a07b-c162df1071a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:58:15.691123 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-d71e991d-b790-4f60-a07b-c162df1071a5 None None] MFA Rules not processed for user `478f31c5215b44038cede750ec95168b`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:58:15.692324 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-d71e991d-b790-4f60-a07b-c162df1071a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:58:15.699206 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 655/1295] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 23 00:58:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:58:16.875146 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efbea5-a6c9-4526-b246-b3d04a1e6710 None None] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:58:16.875622 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efbea5-a6c9-4526-b246-b3d04a1e6710 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:58:16.875709 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efbea5-a6c9-4526-b246-b3d04a1e6710 None None] PATH_INFO: `/` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:58:16.877021 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 641/1296] 10.222.0.23 () {54 vars in 961 bytes} [Sun Oct 23 00:58:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 00:58:16.882250 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861d60d-38a6-45de-adf8-1659e79e85f1 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:58:16.882667 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861d60d-38a6-45de-adf8-1659e79e85f1 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:58:16.882831 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861d60d-38a6-45de-adf8-1659e79e85f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:58:16.901824 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-1861d60d-38a6-45de-adf8-1659e79e85f1 None None] MFA Rules not processed for user `1863d19ad4624ea496c2c73b70ae0c6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 00:58:16.903046 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-1861d60d-38a6-45de-adf8-1659e79e85f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 00:58:16.911928 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 656/1297] 10.222.0.23 () {58 vars in 1058 bytes} [Sun Oct 23 00:58:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 00:58:16.919349 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73efbea5-a6c9-4526-b246-b3d04a1e6710 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:58:16.933274 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73efbea5-a6c9-4526-b246-b3d04a1e6710 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:58:16.938221 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b04b3f-29a0-4797-8ff2-938d372cdeb8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1863d19ad4624ea496c2c73b70ae0c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:58:16.938814 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b04b3f-29a0-4797-8ff2-938d372cdeb8 service placement] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:58:16.939093 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b04b3f-29a0-4797-8ff2-938d372cdeb8 service placement] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:58:16.939363 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b04b3f-29a0-4797-8ff2-938d372cdeb8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:58:16.947806 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b04b3f-29a0-4797-8ff2-938d372cdeb8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:58:16.949387 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b04b3f-29a0-4797-8ff2-938d372cdeb8 service placement] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:58:16.960505 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 642/1298] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:58:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:58:26.896543 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=6 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:58:26.955119 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=6 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 00:58:34.438282 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861d60d-38a6-45de-adf8-1659e79e85f1 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 00:58:34.447604 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861d60d-38a6-45de-adf8-1659e79e85f1 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 00:58:34.451160 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23cbc4-7de5-401c-a1ce-22c716d96d66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04804cfc28b84d398ef06e8e113a755d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 00:58:34.451764 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23cbc4-7de5-401c-a1ce-22c716d96d66 service neutron] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 00:58:34.452044 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23cbc4-7de5-401c-a1ce-22c716d96d66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 00:58:34.452319 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23cbc4-7de5-401c-a1ce-22c716d96d66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 00:58:34.461549 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e23cbc4-7de5-401c-a1ce-22c716d96d66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 00:58:34.463009 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e23cbc4-7de5-401c-a1ce-22c716d96d66 service neutron] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 00:58:34.472504 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 657/1299] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 00:58:34 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 00:58:44.468091 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=6 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:00:18.846728 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b04b3f-29a0-4797-8ff2-938d372cdeb8 service placement] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:00:18.859080 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b04b3f-29a0-4797-8ff2-938d372cdeb8 service placement] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:00:18.864680 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e1b64-0e29-4ec0-a6ac-603800e0d6e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90f691140a8341ada73a8c6f01ad798c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:00:18.865274 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e1b64-0e29-4ec0-a6ac-603800e0d6e5 service nova] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:18.865555 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e1b64-0e29-4ec0-a6ac-603800e0d6e5 service nova] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:18.865827 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e1b64-0e29-4ec0-a6ac-603800e0d6e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:18.873483 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2e1b64-0e29-4ec0-a6ac-603800e0d6e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:00:18.875092 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2e1b64-0e29-4ec0-a6ac-603800e0d6e5 service nova] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:00:18.884307 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 643/1300] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 01:00:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:00:18.931976 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23cbc4-7de5-401c-a1ce-22c716d96d66 service neutron] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:00:18.940953 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23cbc4-7de5-401c-a1ce-22c716d96d66 service neutron] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:00:18.944557 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e447ffc6-ab50-4668-8bc4-d72b201c1c75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04804cfc28b84d398ef06e8e113a755d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:00:18.945148 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447ffc6-ab50-4668-8bc4-d72b201c1c75 service neutron] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:18.945430 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447ffc6-ab50-4668-8bc4-d72b201c1c75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:18.945701 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447ffc6-ab50-4668-8bc4-d72b201c1c75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:18.956042 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e447ffc6-ab50-4668-8bc4-d72b201c1c75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:00:18.957468 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e447ffc6-ab50-4668-8bc4-d72b201c1c75 service neutron] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:00:18.968340 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 658/1301] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 01:00:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:00:20.954830 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e1b64-0e29-4ec0-a6ac-603800e0d6e5 service nova] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:00:21.013936 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e1b64-0e29-4ec0-a6ac-603800e0d6e5 service nova] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:00:21.018225 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32764d14-bc77-4895-a869-750372969c2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57aa88f06f88438c8f0d4d2e65be71c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:00:21.018837 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32764d14-bc77-4895-a869-750372969c2b service cinder] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:21.019124 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32764d14-bc77-4895-a869-750372969c2b service cinder] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:21.019402 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32764d14-bc77-4895-a869-750372969c2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:21.030451 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32764d14-bc77-4895-a869-750372969c2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:00:21.031903 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32764d14-bc77-4895-a869-750372969c2b service cinder] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:00:21.044837 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 644/1302] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 01:00:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:00:28.438100 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5339243-3fef-4d1c-8627-bed3eec01be4 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:28.438569 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5339243-3fef-4d1c-8627-bed3eec01be4 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:28.438665 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5339243-3fef-4d1c-8627-bed3eec01be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:28.458040 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-f5339243-3fef-4d1c-8627-bed3eec01be4 None None] MFA Rules not processed for user `f183fd83a96a4af0bc9df03e6f61ca4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:00:28.459285 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-f5339243-3fef-4d1c-8627-bed3eec01be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:00:28.467249 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 659/1303] 10.222.0.23 () {58 vars in 967 bytes} [Sun Oct 23 01:00:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:00:28.519809 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32764d14-bc77-4895-a869-750372969c2b service cinder] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:00:28.530911 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32764d14-bc77-4895-a869-750372969c2b service cinder] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:00:28.535975 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe11683-2cfd-4716-a14c-4f18564a4375 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84a0345be05644e3a7a71c5a2bf21c41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:00:28.536566 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe11683-2cfd-4716-a14c-4f18564a4375 service swift] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:28.536853 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe11683-2cfd-4716-a14c-4f18564a4375 service swift] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:28.537129 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe11683-2cfd-4716-a14c-4f18564a4375 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:28.544936 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe11683-2cfd-4716-a14c-4f18564a4375 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:00:28.546544 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe11683-2cfd-4716-a14c-4f18564a4375 service swift] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:00:28.554414 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 645/1304] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 23 01:00:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:00:29.038446 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7675a-60f1-4057-8d41-4204bb2fb977 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:29.038934 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7675a-60f1-4057-8d41-4204bb2fb977 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:29.039212 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7675a-60f1-4057-8d41-4204bb2fb977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:29.059316 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-10f7675a-60f1-4057-8d41-4204bb2fb977 None None] MFA Rules not processed for user `f183fd83a96a4af0bc9df03e6f61ca4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:00:29.060686 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-10f7675a-60f1-4057-8d41-4204bb2fb977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:00:29.068925 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 660/1305] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 23 01:00:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:00:29.082266 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe11683-2cfd-4716-a14c-4f18564a4375 service swift] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:00:29.093094 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe11683-2cfd-4716-a14c-4f18564a4375 service swift] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:00:29.098410 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba6c7c-0767-4047-a22d-83fc0bf142f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84a0345be05644e3a7a71c5a2bf21c41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:00:29.099051 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba6c7c-0767-4047-a22d-83fc0bf142f1 service swift] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:29.099338 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba6c7c-0767-4047-a22d-83fc0bf142f1 service swift] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:29.099634 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba6c7c-0767-4047-a22d-83fc0bf142f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:29.108074 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba6c7c-0767-4047-a22d-83fc0bf142f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:00:29.109657 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba6c7c-0767-4047-a22d-83fc0bf142f1 service swift] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:00:29.119115 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 646/1306] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 23 01:00:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:00:37.653849 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d00c27-2eac-42f8-915a-bc3977c7190c None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:37.654366 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d00c27-2eac-42f8-915a-bc3977c7190c None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:37.654474 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d00c27-2eac-42f8-915a-bc3977c7190c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:37.672881 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-43d00c27-2eac-42f8-915a-bc3977c7190c None None] MFA Rules not processed for user `cf373307105d4d598e55154bcc2f400d`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:00:37.674068 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-43d00c27-2eac-42f8-915a-bc3977c7190c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:00:37.680922 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 661/1307] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 23 01:00:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:00:37.978846 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1dceb-a12a-4b7f-a281-3cf139d70e21 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:37.979332 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1dceb-a12a-4b7f-a281-3cf139d70e21 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:37.979419 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1dceb-a12a-4b7f-a281-3cf139d70e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:37.999030 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-f1d1dceb-a12a-4b7f-a281-3cf139d70e21 None None] MFA Rules not processed for user `04804cfc28b84d398ef06e8e113a755d`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:00:38.000240 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-f1d1dceb-a12a-4b7f-a281-3cf139d70e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:00:38.008137 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 647/1308] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 23 01:00:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:00:38.019551 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d00c27-2eac-42f8-915a-bc3977c7190c None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:00:38.028885 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d00c27-2eac-42f8-915a-bc3977c7190c None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:00:38.032421 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eee59d-e350-4e3c-b4e9-f7998eb16e53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04804cfc28b84d398ef06e8e113a755d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:00:38.033015 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eee59d-e350-4e3c-b4e9-f7998eb16e53 service neutron] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:38.033321 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eee59d-e350-4e3c-b4e9-f7998eb16e53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:38.033596 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eee59d-e350-4e3c-b4e9-f7998eb16e53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:38.040836 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eee59d-e350-4e3c-b4e9-f7998eb16e53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:00:38.042322 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eee59d-e350-4e3c-b4e9-f7998eb16e53 service neutron] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:00:38.050435 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 662/1309] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 01:00:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:00:38.394530 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1dceb-a12a-4b7f-a281-3cf139d70e21 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:00:38.407970 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1dceb-a12a-4b7f-a281-3cf139d70e21 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:00:38.413609 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a550f9-29d9-4687-a7d7-096125198381 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1863d19ad4624ea496c2c73b70ae0c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:00:38.414288 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a550f9-29d9-4687-a7d7-096125198381 service placement] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:38.414567 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a550f9-29d9-4687-a7d7-096125198381 service placement] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:38.414834 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a550f9-29d9-4687-a7d7-096125198381 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:38.423532 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a550f9-29d9-4687-a7d7-096125198381 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:00:38.425520 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a550f9-29d9-4687-a7d7-096125198381 service placement] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:00:38.435326 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 648/1310] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 01:00:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:00:39.775696 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0894fe5-4943-4890-b4fe-3c18396cc597 None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:39.776245 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0894fe5-4943-4890-b4fe-3c18396cc597 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:39.776245 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0894fe5-4943-4890-b4fe-3c18396cc597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:39.797006 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-f0894fe5-4943-4890-b4fe-3c18396cc597 None None] MFA Rules not processed for user `f183fd83a96a4af0bc9df03e6f61ca4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:00:39.798406 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-f0894fe5-4943-4890-b4fe-3c18396cc597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:00:39.806772 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 663/1311] 10.222.0.23 () {58 vars in 1009 bytes} [Sun Oct 23 01:00:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:00:39.818591 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a550f9-29d9-4687-a7d7-096125198381 service placement] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:00:39.830343 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a550f9-29d9-4687-a7d7-096125198381 service placement] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:00:39.835370 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7ca4b-9102-4c97-8b34-e29f1db55e05 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84a0345be05644e3a7a71c5a2bf21c41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:00:39.835984 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7ca4b-9102-4c97-8b34-e29f1db55e05 service swift] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:39.836257 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7ca4b-9102-4c97-8b34-e29f1db55e05 service swift] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:39.836532 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7ca4b-9102-4c97-8b34-e29f1db55e05 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:39.846246 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab7ca4b-9102-4c97-8b34-e29f1db55e05 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:00:39.847878 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab7ca4b-9102-4c97-8b34-e29f1db55e05 service swift] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:00:39.856565 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 649/1312] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 23 01:00:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:00:49.791305 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=24 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:00:49.852823 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=59 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:00:50.306753 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0894fe5-4943-4890-b4fe-3c18396cc597 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:00:50.320380 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0894fe5-4943-4890-b4fe-3c18396cc597 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:00:50.321532 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7ca4b-9102-4c97-8b34-e29f1db55e05 service swift] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:00:50.326712 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297a70e-9b2b-47e8-917f-a151ecc25dc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90f691140a8341ada73a8c6f01ad798c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:00:50.327653 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297a70e-9b2b-47e8-917f-a151ecc25dc8 service nova] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:50.328088 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297a70e-9b2b-47e8-917f-a151ecc25dc8 service nova] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:50.328513 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297a70e-9b2b-47e8-917f-a151ecc25dc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:50.331641 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7ca4b-9102-4c97-8b34-e29f1db55e05 service swift] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:00:50.336088 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc455808-57ee-4da0-916c-1bf81f307801 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04804cfc28b84d398ef06e8e113a755d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:00:50.336866 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc455808-57ee-4da0-916c-1bf81f307801 service neutron] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:50.337149 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc455808-57ee-4da0-916c-1bf81f307801 service neutron] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:50.337423 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc455808-57ee-4da0-916c-1bf81f307801 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:50.338853 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f297a70e-9b2b-47e8-917f-a151ecc25dc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:00:50.340973 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f297a70e-9b2b-47e8-917f-a151ecc25dc8 service nova] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:00:50.345588 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc455808-57ee-4da0-916c-1bf81f307801 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:00:50.347109 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc455808-57ee-4da0-916c-1bf81f307801 service neutron] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:00:50.350928 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 664/1313] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 01:00:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:00:50.355121 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 650/1314] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 01:00:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 23 01:00:50.985149 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297a70e-9b2b-47e8-917f-a151ecc25dc8 service nova] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:00:50.996710 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297a70e-9b2b-47e8-917f-a151ecc25dc8 service nova] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:00:51.003185 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad83bc6-26dc-44f0-87e2-e954c75e2688 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90f691140a8341ada73a8c6f01ad798c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:00:51.003844 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad83bc6-26dc-44f0-87e2-e954c75e2688 service nova] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:51.004137 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad83bc6-26dc-44f0-87e2-e954c75e2688 service nova] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:51.004512 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad83bc6-26dc-44f0-87e2-e954c75e2688 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:51.013623 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad83bc6-26dc-44f0-87e2-e954c75e2688 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:00:51.015255 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad83bc6-26dc-44f0-87e2-e954c75e2688 service nova] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:00:51.025882 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 665/1315] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 01:00:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:00:56.428517 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd261e40-80cc-4697-b5dd-e63855e2dd0c None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:56.429478 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd261e40-80cc-4697-b5dd-e63855e2dd0c None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:56.429763 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd261e40-80cc-4697-b5dd-e63855e2dd0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:56.450844 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-bd261e40-80cc-4697-b5dd-e63855e2dd0c None None] MFA Rules not processed for user `478f31c5215b44038cede750ec95168b`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:00:56.452449 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-bd261e40-80cc-4697-b5dd-e63855e2dd0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:00:56.463265 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 651/1316] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 23 01:00:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:00:56.775161 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad83bc6-26dc-44f0-87e2-e954c75e2688 service nova] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:00:56.784935 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad83bc6-26dc-44f0-87e2-e954c75e2688 service nova] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:00:56.788487 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af597405-ac12-483a-963d-bd22c2652572 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04804cfc28b84d398ef06e8e113a755d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:00:56.789081 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af597405-ac12-483a-963d-bd22c2652572 service neutron] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:56.789366 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af597405-ac12-483a-963d-bd22c2652572 service neutron] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:56.789643 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af597405-ac12-483a-963d-bd22c2652572 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:56.796683 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af597405-ac12-483a-963d-bd22c2652572 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:00:56.798150 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af597405-ac12-483a-963d-bd22c2652572 service neutron] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:00:56.805726 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 666/1317] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 01:00:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:00:57.983268 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd261e40-80cc-4697-b5dd-e63855e2dd0c None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:00:57.997217 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd261e40-80cc-4697-b5dd-e63855e2dd0c None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:00:58.002928 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727b8e0-2a6f-4b00-ad58-cc858c5acb4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90f691140a8341ada73a8c6f01ad798c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:00:58.003568 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727b8e0-2a6f-4b00-ad58-cc858c5acb4f service nova] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:00:58.003850 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727b8e0-2a6f-4b00-ad58-cc858c5acb4f service nova] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:00:58.004121 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727b8e0-2a6f-4b00-ad58-cc858c5acb4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:00:58.013420 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6727b8e0-2a6f-4b00-ad58-cc858c5acb4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:00:58.015061 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6727b8e0-2a6f-4b00-ad58-cc858c5acb4f service nova] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:00:58.025265 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 652/1318] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 01:00:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:01:06.802582 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=18 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:08.021022 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=15 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:11.451003 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af597405-ac12-483a-963d-bd22c2652572 service neutron] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:01:11.459919 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af597405-ac12-483a-963d-bd22c2652572 service neutron] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:01:11.463539 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0740fe25-33ec-4716-9c26-37e61195f7e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04804cfc28b84d398ef06e8e113a755d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:01:11.464415 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740fe25-33ec-4716-9c26-37e61195f7e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:11.464695 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740fe25-33ec-4716-9c26-37e61195f7e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:11.464965 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740fe25-33ec-4716-9c26-37e61195f7e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:11.473774 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0740fe25-33ec-4716-9c26-37e61195f7e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:01:11.475230 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0740fe25-33ec-4716-9c26-37e61195f7e3 service neutron] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:01:11.484464 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 667/1319] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 01:01:11 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:01:13.355896 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727b8e0-2a6f-4b00-ad58-cc858c5acb4f service nova] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:01:13.367942 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727b8e0-2a6f-4b00-ad58-cc858c5acb4f service nova] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:01:13.374818 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81a445-0f5d-4dbb-a730-38753a5f3aee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90f691140a8341ada73a8c6f01ad798c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:01:13.376408 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81a445-0f5d-4dbb-a730-38753a5f3aee service nova] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:01:13.376906 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81a445-0f5d-4dbb-a730-38753a5f3aee service nova] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:01:13.377166 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81a445-0f5d-4dbb-a730-38753a5f3aee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:01:13.387205 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a81a445-0f5d-4dbb-a730-38753a5f3aee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:01:13.388964 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a81a445-0f5d-4dbb-a730-38753a5f3aee service nova] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:01:13.400473 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 653/1320] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 01:01:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:01:21.480383 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=6 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:01:23.395929 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=6 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:03:16.843395 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5bd47-b187-4f5b-8888-1dd6e15e5d8b None None] REQUEST_METHOD: `POST` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:03:16.843866 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5bd47-b187-4f5b-8888-1dd6e15e5d8b None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:03:16.843958 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5bd47-b187-4f5b-8888-1dd6e15e5d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:03:16.872190 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.auth.core [None req-bae5bd47-b187-4f5b-8888-1dd6e15e5d8b None None] MFA Rules not processed for user `478f31c5215b44038cede750ec95168b`. Rule list: `[]` (Enabled: `True`). {{(pid=81359) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:03:16.873371 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-bae5bd47-b187-4f5b-8888-1dd6e15e5d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:03:16.895579 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 668/1321] 10.222.0.23 () {58 vars in 958 bytes} [Sun Oct 23 01:03:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:03:18.101285 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81a445-0f5d-4dbb-a730-38753a5f3aee service nova] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:03:18.103016 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-5a81a445-0f5d-4dbb-a730-38753a5f3aee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:03:18.177528 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81a445-0f5d-4dbb-a730-38753a5f3aee service nova] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:03:18.182461 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962e6b5-6bed-4d76-b6e3-7e11712ed9c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1863d19ad4624ea496c2c73b70ae0c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:03:18.183056 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962e6b5-6bed-4d76-b6e3-7e11712ed9c4 service placement] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:03:18.183333 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962e6b5-6bed-4d76-b6e3-7e11712ed9c4 service placement] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:03:18.183604 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962e6b5-6bed-4d76-b6e3-7e11712ed9c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:03:18.185396 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-6962e6b5-6bed-4d76-b6e3-7e11712ed9c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:03:18.196572 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6962e6b5-6bed-4d76-b6e3-7e11712ed9c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:03:18.198163 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6962e6b5-6bed-4d76-b6e3-7e11712ed9c4 service placement] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:03:18.207997 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 654/1322] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 01:03:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:03:26.893911 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=15 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:03:28.203528 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=33 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:03:34.266868 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5bd47-b187-4f5b-8888-1dd6e15e5d8b None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:03:34.268454 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-bae5bd47-b187-4f5b-8888-1dd6e15e5d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:03:34.302481 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5bd47-b187-4f5b-8888-1dd6e15e5d8b None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:03:34.305977 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831a8c6-a061-4f10-b2d2-6891e9094f08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04804cfc28b84d398ef06e8e113a755d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:03:34.306604 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831a8c6-a061-4f10-b2d2-6891e9094f08 service neutron] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:03:34.306885 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831a8c6-a061-4f10-b2d2-6891e9094f08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:03:34.307162 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831a8c6-a061-4f10-b2d2-6891e9094f08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:03:34.315857 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831a8c6-a061-4f10-b2d2-6891e9094f08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:03:34.317273 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831a8c6-a061-4f10-b2d2-6891e9094f08 service neutron] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:03:34.326568 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 669/1323] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 01:03:34 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:03:44.322479 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=15 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:03:47.277604 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7a12e-96d7-4070-9d30-f0d5efdc4ef2 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:03:47.278026 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7a12e-96d7-4070-9d30-f0d5efdc4ef2 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:03:47.278197 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7a12e-96d7-4070-9d30-f0d5efdc4ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:03:47.307568 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-98d7a12e-96d7-4070-9d30-f0d5efdc4ef2 None None] MFA Rules not processed for user `f183fd83a96a4af0bc9df03e6f61ca4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:03:47.308763 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-98d7a12e-96d7-4070-9d30-f0d5efdc4ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:03:47.322066 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 655/1324] 10.222.0.23 () {58 vars in 967 bytes} [Sun Oct 23 01:03:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:03:47.364368 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831a8c6-a061-4f10-b2d2-6891e9094f08 service neutron] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:03:47.375921 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831a8c6-a061-4f10-b2d2-6891e9094f08 service neutron] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:03:47.380895 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f0e02f-b03d-4c35-bdab-fb1e14ea9deb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84a0345be05644e3a7a71c5a2bf21c41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:03:47.381485 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0e02f-b03d-4c35-bdab-fb1e14ea9deb service swift] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:03:47.381764 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0e02f-b03d-4c35-bdab-fb1e14ea9deb service swift] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:03:47.382034 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0e02f-b03d-4c35-bdab-fb1e14ea9deb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:03:47.389834 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f0e02f-b03d-4c35-bdab-fb1e14ea9deb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:03:47.391452 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f0e02f-b03d-4c35-bdab-fb1e14ea9deb service swift] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:03:47.399334 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 670/1325] 10.222.0.23 () {60 vars in 1384 bytes} [Sun Oct 23 01:03:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 23 01:03:47.750931 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7a12e-96d7-4070-9d30-f0d5efdc4ef2 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:03:47.760137 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7a12e-96d7-4070-9d30-f0d5efdc4ef2 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:03:47.763691 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a37bf7-e943-45fa-bb5c-78bb3edeed3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04804cfc28b84d398ef06e8e113a755d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:03:47.764288 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a37bf7-e943-45fa-bb5c-78bb3edeed3f service neutron] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:03:47.764567 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a37bf7-e943-45fa-bb5c-78bb3edeed3f service neutron] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:03:47.764857 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a37bf7-e943-45fa-bb5c-78bb3edeed3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:03:47.834159 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a37bf7-e943-45fa-bb5c-78bb3edeed3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:03:47.835597 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a37bf7-e943-45fa-bb5c-78bb3edeed3f service neutron] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:03:47.854428 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 656/1326] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 01:03:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:03:51.145608 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620119f7-5857-4d18-bb56-312ddd2a7a48 None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:03:51.146182 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620119f7-5857-4d18-bb56-312ddd2a7a48 None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:03:51.146264 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620119f7-5857-4d18-bb56-312ddd2a7a48 None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:03:51.147593 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 671/1327] 10.222.0.23 () {54 vars in 921 bytes} [Sun Oct 23 01:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:03:51.159281 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef786ac-efd3-42a3-a17b-0a4194d97de7 None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:03:51.159734 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef786ac-efd3-42a3-a17b-0a4194d97de7 None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:03:51.159825 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef786ac-efd3-42a3-a17b-0a4194d97de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:03:51.213567 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-eef786ac-efd3-42a3-a17b-0a4194d97de7 None None] MFA Rules not processed for user `1863d19ad4624ea496c2c73b70ae0c6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:03:51.214763 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-eef786ac-efd3-42a3-a17b-0a4194d97de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:03:51.224331 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 657/1328] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Oct 23 01:03:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 23 01:03:51.237555 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620119f7-5857-4d18-bb56-312ddd2a7a48 None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:03:51.252140 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620119f7-5857-4d18-bb56-312ddd2a7a48 None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:03:51.257399 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a165d7-6ada-49e6-8102-6bc3e6f20339 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1863d19ad4624ea496c2c73b70ae0c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:03:51.258330 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a165d7-6ada-49e6-8102-6bc3e6f20339 service placement] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:03:51.258729 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a165d7-6ada-49e6-8102-6bc3e6f20339 service placement] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:03:51.259007 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a165d7-6ada-49e6-8102-6bc3e6f20339 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:03:51.268908 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a165d7-6ada-49e6-8102-6bc3e6f20339 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:03:51.270521 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a165d7-6ada-49e6-8102-6bc3e6f20339 service placement] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:03:51.280296 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 672/1329] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 01:03:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:03:54.252246 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef786ac-efd3-42a3-a17b-0a4194d97de7 None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:03:54.274833 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef786ac-efd3-42a3-a17b-0a4194d97de7 None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:03:54.281572 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85730d31-7f45-4343-9f58-0e28f42ddba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:03:54.282560 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85730d31-7f45-4343-9f58-0e28f42ddba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:03:54.282845 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85730d31-7f45-4343-9f58-0e28f42ddba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:03:54.283193 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85730d31-7f45-4343-9f58-0e28f42ddba9 admin admin] PATH_INFO: `/v3/users/cf373307105d4d598e55154bcc2f400d` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:03:54.284362 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85730d31-7f45-4343-9f58-0e28f42ddba9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf373307105d4d598e55154bcc2f400d)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:03:54.286424 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85730d31-7f45-4343-9f58-0e28f42ddba9 admin admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:03:54.346729 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [None req-85730d31-7f45-4343-9f58-0e28f42ddba9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf373307105d4d598e55154bcc2f400d'} {{(pid=81358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:03:54.353639 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [None req-85730d31-7f45-4343-9f58-0e28f42ddba9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf373307105d4d598e55154bcc2f400d'} {{(pid=81358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:03:54.354318 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [None req-85730d31-7f45-4343-9f58-0e28f42ddba9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf373307105d4d598e55154bcc2f400d'} {{(pid=81358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:03:54.361878 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [None req-85730d31-7f45-4343-9f58-0e28f42ddba9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf373307105d4d598e55154bcc2f400d'} {{(pid=81358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:03:54.375611 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [None req-85730d31-7f45-4343-9f58-0e28f42ddba9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf373307105d4d598e55154bcc2f400d'} {{(pid=81358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:03:54.377214 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:03:54.383656 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 658/1330] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 23 01:03:54 2022] DELETE /identity/v3/users/cf373307105d4d598e55154bcc2f400d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:03:54.550374 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a165d7-6ada-49e6-8102-6bc3e6f20339 service placement] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:03:54.562816 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a165d7-6ada-49e6-8102-6bc3e6f20339 service placement] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:03:54.619657 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2cbe77-45f0-4986-86da-3a5fc24fdd88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:03:54.620286 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cbe77-45f0-4986-86da-3a5fc24fdd88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:03:54.620589 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cbe77-45f0-4986-86da-3a5fc24fdd88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:03:54.620855 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cbe77-45f0-4986-86da-3a5fc24fdd88 admin admin] PATH_INFO: `/v3/projects/ddb09ea4eac54254baab5c2ec5455f67` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:03:54.621945 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2cbe77-45f0-4986-86da-3a5fc24fdd88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddb09ea4eac54254baab5c2ec5455f67)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:03:54.624510 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2cbe77-45f0-4986-86da-3a5fc24fdd88 admin admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:03:54.669644 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [None req-9b2cbe77-45f0-4986-86da-3a5fc24fdd88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddb09ea4eac54254baab5c2ec5455f67', 'request_id': 'req-9b2cbe77-45f0-4986-86da-3a5fc24fdd88'} {{(pid=81359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:03:54.677114 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [None req-9b2cbe77-45f0-4986-86da-3a5fc24fdd88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddb09ea4eac54254baab5c2ec5455f67', 'request_id': 'req-9b2cbe77-45f0-4986-86da-3a5fc24fdd88'} {{(pid=81359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:03:54.682603 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [None req-9b2cbe77-45f0-4986-86da-3a5fc24fdd88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddb09ea4eac54254baab5c2ec5455f67', 'request_id': 'req-9b2cbe77-45f0-4986-86da-3a5fc24fdd88'} {{(pid=81359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:03:54.706604 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [None req-9b2cbe77-45f0-4986-86da-3a5fc24fdd88 admin admin] The token cache is being invalidate because project ddb09ea4eac54254baab5c2ec5455f67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:03:54.706888 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [None req-9b2cbe77-45f0-4986-86da-3a5fc24fdd88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:03:54.707771 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [None req-9b2cbe77-45f0-4986-86da-3a5fc24fdd88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:03:54.709237 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 673/1331] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 23 01:03:54 2022] DELETE /identity/v3/projects/ddb09ea4eac54254baab5c2ec5455f67 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:03:54.713190 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85730d31-7f45-4343-9f58-0e28f42ddba9 admin admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:03:54.714670 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-85730d31-7f45-4343-9f58-0e28f42ddba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:03:54.727472 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85730d31-7f45-4343-9f58-0e28f42ddba9 admin admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:03:54.783365 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb982643-cc6f-440f-82b7-9d13fab91258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:03:54.783916 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb982643-cc6f-440f-82b7-9d13fab91258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:03:54.784220 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb982643-cc6f-440f-82b7-9d13fab91258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:03:54.784491 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb982643-cc6f-440f-82b7-9d13fab91258 admin admin] PATH_INFO: `/v3/users/a11186c8a8ab4189a508a664158297c7` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:03:54.785589 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb982643-cc6f-440f-82b7-9d13fab91258 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a11186c8a8ab4189a508a664158297c7)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:03:54.787529 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb982643-cc6f-440f-82b7-9d13fab91258 admin admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:03:54.832415 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [None req-cb982643-cc6f-440f-82b7-9d13fab91258 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a11186c8a8ab4189a508a664158297c7'} {{(pid=81358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:03:54.839191 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [None req-cb982643-cc6f-440f-82b7-9d13fab91258 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a11186c8a8ab4189a508a664158297c7'} {{(pid=81358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:03:54.839841 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [None req-cb982643-cc6f-440f-82b7-9d13fab91258 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a11186c8a8ab4189a508a664158297c7'} {{(pid=81358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:03:54.846643 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [None req-cb982643-cc6f-440f-82b7-9d13fab91258 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a11186c8a8ab4189a508a664158297c7'} {{(pid=81358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:03:54.858626 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [None req-cb982643-cc6f-440f-82b7-9d13fab91258 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a11186c8a8ab4189a508a664158297c7'} {{(pid=81358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:03:54.864410 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 659/1332] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 23 01:03:54 2022] DELETE /identity/v3/users/a11186c8a8ab4189a508a664158297c7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:03:55.030801 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2cbe77-45f0-4986-86da-3a5fc24fdd88 admin admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:03:55.032321 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-9b2cbe77-45f0-4986-86da-3a5fc24fdd88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:03:55.045059 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2cbe77-45f0-4986-86da-3a5fc24fdd88 admin admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:03:55.100491 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:03:55.111411 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987f2c6-ef18-4ee9-a0b7-fd81660812c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:03:55.112042 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987f2c6-ef18-4ee9-a0b7-fd81660812c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:03:55.112319 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987f2c6-ef18-4ee9-a0b7-fd81660812c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:03:55.112584 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987f2c6-ef18-4ee9-a0b7-fd81660812c2 admin admin] PATH_INFO: `/v3/projects/0d2881f36862464389c29e2ee3afb41c` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:03:55.113724 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987f2c6-ef18-4ee9-a0b7-fd81660812c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d2881f36862464389c29e2ee3afb41c)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:03:55.115658 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987f2c6-ef18-4ee9-a0b7-fd81660812c2 admin admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:03:55.160927 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [None req-7987f2c6-ef18-4ee9-a0b7-fd81660812c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d2881f36862464389c29e2ee3afb41c', 'request_id': 'req-7987f2c6-ef18-4ee9-a0b7-fd81660812c2'} {{(pid=81359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:03:55.168777 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [None req-7987f2c6-ef18-4ee9-a0b7-fd81660812c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d2881f36862464389c29e2ee3afb41c', 'request_id': 'req-7987f2c6-ef18-4ee9-a0b7-fd81660812c2'} {{(pid=81359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:03:55.175063 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [None req-7987f2c6-ef18-4ee9-a0b7-fd81660812c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d2881f36862464389c29e2ee3afb41c', 'request_id': 'req-7987f2c6-ef18-4ee9-a0b7-fd81660812c2'} {{(pid=81359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:03:55.187385 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [None req-7987f2c6-ef18-4ee9-a0b7-fd81660812c2 admin admin] The token cache is being invalidate because project 0d2881f36862464389c29e2ee3afb41c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:03:55.187692 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [None req-7987f2c6-ef18-4ee9-a0b7-fd81660812c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:03:55.188331 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [None req-7987f2c6-ef18-4ee9-a0b7-fd81660812c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:03:55.189842 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 674/1333] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 23 01:03:55 2022] DELETE /identity/v3/projects/0d2881f36862464389c29e2ee3afb41c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:04:04.861056 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:04:05.184349 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=27,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:05:27.492544 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb982643-cc6f-440f-82b7-9d13fab91258 admin admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:05:27.494141 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-cb982643-cc6f-440f-82b7-9d13fab91258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:05:27.553043 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb982643-cc6f-440f-82b7-9d13fab91258 admin admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:05:27.601206 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c97b1-7ceb-4e2d-87e4-16f72015543b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04804cfc28b84d398ef06e8e113a755d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:05:27.601828 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c97b1-7ceb-4e2d-87e4-16f72015543b service neutron] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:05:27.602161 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c97b1-7ceb-4e2d-87e4-16f72015543b service neutron] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:05:27.602413 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c97b1-7ceb-4e2d-87e4-16f72015543b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:05:27.604165 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-816c97b1-7ceb-4e2d-87e4-16f72015543b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:05:27.687803 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816c97b1-7ceb-4e2d-87e4-16f72015543b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:05:27.689190 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816c97b1-7ceb-4e2d-87e4-16f72015543b service neutron] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:05:27.710124 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 660/1334] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 01:05:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:05:28.892549 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987f2c6-ef18-4ee9-a0b7-fd81660812c2 admin admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:05:28.894025 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-7987f2c6-ef18-4ee9-a0b7-fd81660812c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:05:28.905836 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987f2c6-ef18-4ee9-a0b7-fd81660812c2 admin admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:05:28.909380 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90576398-6c35-44f6-b0af-afbf085ed998 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04804cfc28b84d398ef06e8e113a755d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:05:28.909977 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90576398-6c35-44f6-b0af-afbf085ed998 service neutron] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:05:28.910285 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90576398-6c35-44f6-b0af-afbf085ed998 service neutron] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:05:28.910559 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90576398-6c35-44f6-b0af-afbf085ed998 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:05:28.912202 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-90576398-6c35-44f6-b0af-afbf085ed998 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:05:28.925227 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90576398-6c35-44f6-b0af-afbf085ed998 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:05:28.926690 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90576398-6c35-44f6-b0af-afbf085ed998 service neutron] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:05:28.937655 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 675/1335] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 01:05:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:05:37.707007 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=83 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:05:38.932694 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=6 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:05:39.700551 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c97b1-7ceb-4e2d-87e4-16f72015543b service neutron] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:05:39.709920 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c97b1-7ceb-4e2d-87e4-16f72015543b service neutron] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:05:39.713512 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a888214-4586-45d5-8bee-e2a8d02a9f7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04804cfc28b84d398ef06e8e113a755d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:05:39.714132 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a888214-4586-45d5-8bee-e2a8d02a9f7c service neutron] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:05:39.714417 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a888214-4586-45d5-8bee-e2a8d02a9f7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:05:39.714689 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a888214-4586-45d5-8bee-e2a8d02a9f7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:05:39.716367 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-2a888214-4586-45d5-8bee-e2a8d02a9f7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:05:39.778220 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a888214-4586-45d5-8bee-e2a8d02a9f7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:05:39.779584 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a888214-4586-45d5-8bee-e2a8d02a9f7c service neutron] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:05:39.789046 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 661/1336] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 01:05:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:05:42.839699 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce09b22-066c-4fc0-b37a-2d3c7054551c None None] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:05:42.840264 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce09b22-066c-4fc0-b37a-2d3c7054551c None None] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:05:42.840371 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce09b22-066c-4fc0-b37a-2d3c7054551c None None] PATH_INFO: `/` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:05:42.841853 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 676/1337] 10.222.0.23 () {54 vars in 921 bytes} [Sun Oct 23 01:05:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 23 01:05:42.849386 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e58d34-4aea-4e42-9520-c2c11a124aad None None] REQUEST_METHOD: `POST` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:05:42.849770 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e58d34-4aea-4e42-9520-c2c11a124aad None None] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:05:42.849926 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e58d34-4aea-4e42-9520-c2c11a124aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:05:42.870978 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.auth.core [None req-39e58d34-4aea-4e42-9520-c2c11a124aad None None] MFA Rules not processed for user `1863d19ad4624ea496c2c73b70ae0c6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 23 01:05:42.872197 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-39e58d34-4aea-4e42-9520-c2c11a124aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:05:42.942121 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 662/1338] 10.222.0.23 () {58 vars in 1018 bytes} [Sun Oct 23 01:05:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 23 01:05:42.967940 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce09b22-066c-4fc0-b37a-2d3c7054551c None None] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:05:42.969614 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-1ce09b22-066c-4fc0-b37a-2d3c7054551c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:05:42.988513 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce09b22-066c-4fc0-b37a-2d3c7054551c None None] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:05:42.993644 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5a743-8cbc-48d8-bb4b-d6719ab3eb15 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1863d19ad4624ea496c2c73b70ae0c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:05:42.994272 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5a743-8cbc-48d8-bb4b-d6719ab3eb15 service placement] REQUEST_METHOD: `GET` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:05:42.994664 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5a743-8cbc-48d8-bb4b-d6719ab3eb15 service placement] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:05:42.994960 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5a743-8cbc-48d8-bb4b-d6719ab3eb15 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:05:43.003590 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d5a743-8cbc-48d8-bb4b-d6719ab3eb15 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:05:43.005209 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d5a743-8cbc-48d8-bb4b-d6719ab3eb15 service placement] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:05:43.015254 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 677/1339] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 01:05:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:05:46.049548 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e58d34-4aea-4e42-9520-c2c11a124aad None None] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:05:46.051019 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-39e58d34-4aea-4e42-9520-c2c11a124aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:05:46.067436 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e58d34-4aea-4e42-9520-c2c11a124aad None None] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:05:46.073349 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab5285-bb39-4413-b1ff-06acbdcba1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:05:46.074016 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab5285-bb39-4413-b1ff-06acbdcba1a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:05:46.074315 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab5285-bb39-4413-b1ff-06acbdcba1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:05:46.074839 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab5285-bb39-4413-b1ff-06acbdcba1a7 admin admin] PATH_INFO: `/v3/users/478f31c5215b44038cede750ec95168b` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:05:46.089886 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab5285-bb39-4413-b1ff-06acbdcba1a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=478f31c5215b44038cede750ec95168b)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:05:46.091825 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab5285-bb39-4413-b1ff-06acbdcba1a7 admin admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:05:46.144263 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [None req-6aab5285-bb39-4413-b1ff-06acbdcba1a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '478f31c5215b44038cede750ec95168b'} {{(pid=81358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:05:46.151045 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [None req-6aab5285-bb39-4413-b1ff-06acbdcba1a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '478f31c5215b44038cede750ec95168b'} {{(pid=81358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:05:46.151731 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [None req-6aab5285-bb39-4413-b1ff-06acbdcba1a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '478f31c5215b44038cede750ec95168b'} {{(pid=81358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:05:46.158919 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [None req-6aab5285-bb39-4413-b1ff-06acbdcba1a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '478f31c5215b44038cede750ec95168b'} {{(pid=81358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:05:46.166968 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:05:46.171740 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [None req-6aab5285-bb39-4413-b1ff-06acbdcba1a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '478f31c5215b44038cede750ec95168b'} {{(pid=81358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:05:46.178654 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 663/1340] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 23 01:05:46 2022] DELETE /identity/v3/users/478f31c5215b44038cede750ec95168b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:05:46.358607 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5a743-8cbc-48d8-bb4b-d6719ab3eb15 service placement] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:05:46.369662 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5a743-8cbc-48d8-bb4b-d6719ab3eb15 service placement] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:05:46.425290 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae03cc-e906-4b79-924a-b1aa24cd4ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:05:46.425912 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae03cc-e906-4b79-924a-b1aa24cd4ee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:05:46.426227 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae03cc-e906-4b79-924a-b1aa24cd4ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:05:46.426503 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae03cc-e906-4b79-924a-b1aa24cd4ee2 admin admin] PATH_INFO: `/v3/projects/c0e3d13411094438a53a403b1e8636cf` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:05:46.436520 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae03cc-e906-4b79-924a-b1aa24cd4ee2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0e3d13411094438a53a403b1e8636cf)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:05:46.438959 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae03cc-e906-4b79-924a-b1aa24cd4ee2 admin admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:05:46.483879 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [None req-6dae03cc-e906-4b79-924a-b1aa24cd4ee2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0e3d13411094438a53a403b1e8636cf', 'request_id': 'req-6dae03cc-e906-4b79-924a-b1aa24cd4ee2'} {{(pid=81359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:05:46.490983 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [None req-6dae03cc-e906-4b79-924a-b1aa24cd4ee2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0e3d13411094438a53a403b1e8636cf', 'request_id': 'req-6dae03cc-e906-4b79-924a-b1aa24cd4ee2'} {{(pid=81359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:05:46.496659 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [None req-6dae03cc-e906-4b79-924a-b1aa24cd4ee2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0e3d13411094438a53a403b1e8636cf', 'request_id': 'req-6dae03cc-e906-4b79-924a-b1aa24cd4ee2'} {{(pid=81359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:05:46.508451 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [None req-6dae03cc-e906-4b79-924a-b1aa24cd4ee2 admin admin] The token cache is being invalidate because project c0e3d13411094438a53a403b1e8636cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:05:46.508737 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [None req-6dae03cc-e906-4b79-924a-b1aa24cd4ee2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:05:46.509361 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [None req-6dae03cc-e906-4b79-924a-b1aa24cd4ee2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:05:46.510871 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 678/1341] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 23 01:05:46 2022] DELETE /identity/v3/projects/c0e3d13411094438a53a403b1e8636cf => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:05:46.514980 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab5285-bb39-4413-b1ff-06acbdcba1a7 admin admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:05:46.516994 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-6aab5285-bb39-4413-b1ff-06acbdcba1a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:05:46.529846 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab5285-bb39-4413-b1ff-06acbdcba1a7 admin admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:05:46.587219 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ddcce-934d-4fc5-8dc3-4c6164ed4209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:05:46.587843 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ddcce-934d-4fc5-8dc3-4c6164ed4209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:05:46.588120 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ddcce-934d-4fc5-8dc3-4c6164ed4209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:05:46.588389 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ddcce-934d-4fc5-8dc3-4c6164ed4209 admin admin] PATH_INFO: `/v3/users/cd08ad9f9ac1413cadfc4f7c92e114bb` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:05:46.601167 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ddcce-934d-4fc5-8dc3-4c6164ed4209 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd08ad9f9ac1413cadfc4f7c92e114bb)` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:05:46.603153 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ddcce-934d-4fc5-8dc3-4c6164ed4209 admin admin] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:05:46.649144 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [None req-7a4ddcce-934d-4fc5-8dc3-4c6164ed4209 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd08ad9f9ac1413cadfc4f7c92e114bb'} {{(pid=81358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:05:46.655905 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [None req-7a4ddcce-934d-4fc5-8dc3-4c6164ed4209 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd08ad9f9ac1413cadfc4f7c92e114bb'} {{(pid=81358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:05:46.656557 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [None req-7a4ddcce-934d-4fc5-8dc3-4c6164ed4209 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd08ad9f9ac1413cadfc4f7c92e114bb'} {{(pid=81358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:05:46.663429 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [None req-7a4ddcce-934d-4fc5-8dc3-4c6164ed4209 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd08ad9f9ac1413cadfc4f7c92e114bb'} {{(pid=81358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:05:46.675212 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.notifications [None req-7a4ddcce-934d-4fc5-8dc3-4c6164ed4209 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd08ad9f9ac1413cadfc4f7c92e114bb'} {{(pid=81358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:05:46.681016 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 664/1342] 10.222.0.23 () {58 vars in 1224 bytes} [Sun Oct 23 01:05:46 2022] DELETE /identity/v3/users/cd08ad9f9ac1413cadfc4f7c92e114bb => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 23 01:05:46.855294 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae03cc-e906-4b79-924a-b1aa24cd4ee2 admin admin] Authenticating user token {{(pid=81359) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:05:46.856730 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.fernet_utils [None req-6dae03cc-e906-4b79-924a-b1aa24cd4ee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81359) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:05:46.876356 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae03cc-e906-4b79-924a-b1aa24cd4ee2 admin admin] Validating token access rules against request {{(pid=81359) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:05:46.931250 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcffb11-cd9f-477f-bdda-c207e394ada5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39aa566fa6c64c41804fb6eefcbf0c20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e595cb6a4664ac2825c0ea6a16cb095', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81359) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:05:46.931877 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcffb11-cd9f-477f-bdda-c207e394ada5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:05:46.932156 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcffb11-cd9f-477f-bdda-c207e394ada5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:05:46.932428 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcffb11-cd9f-477f-bdda-c207e394ada5 admin admin] PATH_INFO: `/v3/projects/80857ec283804378966c744c4bb14461` {{(pid=81359) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:05:46.943104 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcffb11-cd9f-477f-bdda-c207e394ada5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80857ec283804378966c744c4bb14461)` {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:05:46.945021 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcffb11-cd9f-477f-bdda-c207e394ada5 admin admin] RBAC: Authorization granted {{(pid=81359) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:05:46.946407 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:05:46.991725 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [None req-9dcffb11-cd9f-477f-bdda-c207e394ada5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80857ec283804378966c744c4bb14461', 'request_id': 'req-9dcffb11-cd9f-477f-bdda-c207e394ada5'} {{(pid=81359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:05:46.998883 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [None req-9dcffb11-cd9f-477f-bdda-c207e394ada5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80857ec283804378966c744c4bb14461', 'request_id': 'req-9dcffb11-cd9f-477f-bdda-c207e394ada5'} {{(pid=81359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:05:47.005622 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [None req-9dcffb11-cd9f-477f-bdda-c207e394ada5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80857ec283804378966c744c4bb14461', 'request_id': 'req-9dcffb11-cd9f-477f-bdda-c207e394ada5'} {{(pid=81359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:05:47.017016 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [None req-9dcffb11-cd9f-477f-bdda-c207e394ada5 admin admin] The token cache is being invalidate because project 80857ec283804378966c744c4bb14461 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81359) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 23 01:05:47.017305 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [None req-9dcffb11-cd9f-477f-bdda-c207e394ada5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:05:47.017961 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG keystone.notifications [None req-9dcffb11-cd9f-477f-bdda-c207e394ada5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81359) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 23 01:05:47.019487 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: [pid: 81359|app: 0|req: 679/1343] 10.222.0.23 () {58 vars in 1233 bytes} [Sun Oct 23 01:05:46 2022] DELETE /identity/v3/projects/80857ec283804378966c744c4bb14461 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 23 01:05:56.677599 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=61,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:05:57.014173 dv-osbrick-master-4-iscsi devstack@keystone.service[81359]: DEBUG dbcounter [-] [81359] Writing DB stats keystone:SELECT=24,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81359) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 23 01:09:14.604089 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ddcce-934d-4fc5-8dc3-4c6164ed4209 admin admin] Authenticating user token {{(pid=81358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 23 01:09:14.605526 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-7a4ddcce-934d-4fc5-8dc3-4c6164ed4209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:09:14.672517 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ddcce-934d-4fc5-8dc3-4c6164ed4209 admin admin] Validating token access rules against request {{(pid=81358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 23 01:09:14.729675 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c118e2-c8a6-42c0-b7ff-b4e0316fe810 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1863d19ad4624ea496c2c73b70ae0c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60f8594760e44ce3888a32702ea9afcc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 23 01:09:14.730299 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c118e2-c8a6-42c0-b7ff-b4e0316fe810 service placement] REQUEST_METHOD: `GET` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 23 01:09:14.730577 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c118e2-c8a6-42c0-b7ff-b4e0316fe810 service placement] SCRIPT_NAME: `/identity` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 23 01:09:14.730853 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c118e2-c8a6-42c0-b7ff-b4e0316fe810 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 23 01:09:14.732552 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.fernet_utils [None req-44c118e2-c8a6-42c0-b7ff-b4e0316fe810 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 23 01:09:14.743031 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c118e2-c8a6-42c0-b7ff-b4e0316fe810 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 23 01:09:14.744591 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c118e2-c8a6-42c0-b7ff-b4e0316fe810 service placement] RBAC: Authorization granted {{(pid=81358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 23 01:09:14.754496 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: [pid: 81358|app: 0|req: 665/1344] 10.222.0.23 () {60 vars in 1365 bytes} [Sun Oct 23 01:09:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 23 01:09:24.750053 dv-osbrick-master-4-iscsi devstack@keystone.service[81358]: DEBUG dbcounter [-] [81358] Writing DB stats keystone:SELECT=58 {{(pid=81358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}